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Preface 



This text is a second generation descendent of our text, Digital Signal Processing, which 
was published in 1975. At that time, the technical field of digital signal processing was 
in its infancy, but certain basic principles had emerged and could be organized into 
a coherent presentation. Although courses existed at a few schools, they were almost 
exclusively at the graduate level. The original text was designed for such courses. 

By 1985, the pace of research and integrated circuit technology made it clear 
that digital signal processing would realize the potential that had been evident in the 
1970s. The burgeoning importance of DSP clearly justified a revision and updating of the 
original text. However, in organizing that revision, it was clear that so many changes had 
occurred that it was most appropriate to develop a new textbook, strongly based on our 
original text, while keeping the original text in print. We titled the new book Discrete- 
Time Signal Processing to emphasize that most of the theory and design techniques 
discussed in the text apply to discrete-time systems in general. 

By the time Discrete-Time Signal Processing was published in 1989, the basic 
principles of DSP were commonly taught at the undergraduate level, sometimes even 
as part of a first course on linear systems, or at a somewhat more advanced level in 
third-year, fourth-year, or beginning graduate subjects. Therefore, it was appropriate to 
expand considerably the treatment of such topics as linear systems, sampling, multirate 
signal processing, applications, and spectral analysis. In addition, more examples were 
included to emphasize and illustrate important concepts. We also removed and con- 
densed some topics that time had shown were not fundamental to the understanding of 
discrete-time signal processing. Consistent with the importance that we placed on well 
constructed examples and homework problems, the new text contained more than 400 
problems. 

In the decade or so since Discrete-Time Signal Processing was published, some 
important new concepts have been developed, the capability of digital integrated cir- 
cuits has grown exponentially, and an increasing number of applications have emerged. 
However, the underlying basics and fundamentals remain largely the same albeit with 
a refinement of emphasis, understanding and pedagogy. Consequently when we looked 
at what was needed to keep Discrete-Time Signal Processing up-to-date as a textbook 
emphasizing the fundamentals of DSP, we found that the changes needed were far less 
drastic than before. In planning this current revision we were guided by the princi- 
ple that the main objective of a fundamental textbook is to uncover a subject rather 
than to cover it. Consequently, our goal in this current revision is to make the sub- 
ject of discrete-time signal processing even more accessible to students and practicing 
engineers, without compromising on coverage of what we consider to be the essential 
concepts that define the field. Toward this end we have considerably expanded our cov- 
erage of multi-rate signal processing due to its importance in oversampled A-to-D and 
D-to- A conversion and digital filter implementation. We have added a discussion of the 
cosine transform, which plays a central role in data compression standards. We have 
also removed some material that we judged to be of lesser importance in the present 
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xx Preface 

context, or more appropriate for advanced textbooks and upper level graduate courses. 
Many of the concepts that were removed from the text (such as basic results on the 
cepstrum) have reappeared in some of the new homework problems. 

A major part of our emphasis in this revision has been directed toward the home- 
work problems and examples. We have significantly increased the number of examples 
which are important in illustrating and understanding the basic concepts, and we have 
increased the number of homework problems. Furthermore, the homework problems 
have been reorganized according to their level of difficulty and sophistication, and an- 
swers are provided to a selected set of problems. The instructor's manual available from 
the publisher contains updated solutions for all of the problems in the book. These so- 
lutions were prepared by Li Lee and Maya Said of MIT and Jordan Rosenthal and 
Greg Slabaugh of Georgia Tech. This manual also contains some suggested exam prob- 
lems based on our courses at MIT, Georgia Tech and the University of Massachusetts 
Dartmouth. 

As in the earlier texts, it is assumed that the reader has a background of advanced 
calculus, along with a good understanding of the elements of complex numbers and vari- 
ables. In this edition, we have refrained from the use of complex contour integration 
in order to make the discussion accessible to a wider audience. An exposure to linear 
system theory for continuous-time signals, including Laplace and Fourier transforms, 
as taught in most undergraduate electrical and mechanical engineering curricula is still 
a basic prerequisite. With this background, the book is self-contained. In particular, no 
prior experience with discrete-time signals, ^-transforms, discrete Fourier transforms, 
and the like is assumed. In later sections of some chapters, some topics such as quanti- 
zation noise are included that assume a basic background in stochastic signals. A brief 
review of the background for these sections is included in Chapter 2 and in Appendix A. 

It has become common in many signal processing courses to include exercises to be 
done on a computer, and many of the homework problems in this book are easily turned 
into problems to be solved with the aid of a computer. As in the first edition, we have 
purposely avoided providing special software to implement algorithms described in this 
book, for a variety of reasons. Foremost among them is that there are a variety of in- 
expensive signal processing software packages readily available for demonstrating and 
implementing signal processing on any of the popular personal computers and work- 
stations. These packages are well documented and have excellent technical support, 
and many of them have excellent user interfaces that make them easily accessible to 
students. Furthermore, they are in a constant state of evolution, which strongly suggests 
that available software for classroom use should be constantly reviewed and updated. 
We share the enthusiasm of many for MATLAB, which an increasing number of stu- 
dents are learning at early stages of their education. However, we continue to prefer a 
presentation that utilizes the power of computational tools such as MATLAB to create 
examples and illustrations of the theory and fundamentals for use in the text, but does 
not let issues of programming syntax and functionality of the software environment 
detract from the emphasis on the concepts and the way that they are used. We firmly 
believe that there is enormous value in hands-on experience. Indeed, software tools 
such as MATLAB allow students to implement sophisticated signal processing systems 
on their own personal computers, and we feel that there is great benefit to this once 
the student is confident of the fundamentals and is capable of sorting out programming 
mistakes from conceptual errors. For this reason, the instructor's manual contains a sec- 
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tion of suggestions for assignments in the inexpensive texts Computer- Based Exercises 
for Signal Processing Using Matlab 5 by McClellan, et al., and Computer Explorations 
in Signals and Systems Using Matlab by Buck, Daniel and Singer, both of which are 
also available from Prentice-Hall, Inc. These suggestions link projects in these com- 
puter exercise books to specific sections, examples and problems in this textbook. This 
will allow instructors to design computer assignments which are related to the material 
and examples they have covered in class, and to link these computer assignments to 
traditional analytic homework problems to reinforce the concepts demonstrated there. 

The material in this book is organized in a way that provides considerable flexi- 
bility in its use at both the undergraduate and graduate level. A typical one-semester 
undergraduate elective might cover in depth Chapter 2, Sections 2.0-2.9; Chapter 3; 
Chapter 4, Sections 4.0-4.6; Chapter 5, Sections 5.0-5.3; Chapter 6, Sections 6.0-6.5; 
Chapter 7, Sections 7.0-7.3 and a brief overview of Sections 7.4-7.5. If students have 
studied discrete-time signals and systems in a general signals and systems course, it 
would be possible to move more quickly through the material of Chapters 2, 3, and 4, 
thus freeing time for covering Chapter 8. A first-year graduate course could augment 
the above topics with the remaining topics in Chapter 5, a discussion of multirate signal 
processing (Section 4.7) an exposure to some of the quantization issues introduced in 
Section 4.8 and perhaps an introduction to noise shaping in A/D and D/A converters as 
discussed in Section 4.9. A first-year graduate course should also include exposure to 
some of the quantization issues addressed in Sections 6.6-6.9, to a discussion of optimal 
FIR filters as incorporated in Sections 7.4 and 7.5, and a thorough treatment of the 
discrete Fourier transform (Chapter 8) and its computation using the FFT (Chapter 9). 
The discussion of the DFT can be effectively augmented with many of the examples in 
Chapter 10. In a two-semester graduate course, the entire text together with a number 
of additional advanced topics can be covered. 

In Chapter 2, we introduce the basic class of discrete-time signals and systems and 
define basic system properties such as linearity, time invariance, stability, and causality. 
The primary focus of the book is on linear time-invariant systems because of the rich 
set of tools available for designing and analyzing this class of systems. In particular, in 
Chapter 2 we develop the time-domain representation of linear time-invariant systems 
through the convolution sum and introduce the class of linear time-invariant systems 
represented by linear constant-coefficient difference equations. In Chapter 6, we de- 
velop this class of systems in considerably more detail. Also in Chapter 2 we introduce 
the frequency-domain representation of signals and systems through the Fourier trans- 
form. The primary focus in Chapter 2 is on the representation of sequences in terms 
of the Fourier transform, i.e., as a linear combination of complex exponentials, and the 
development of the basic properties of the Fourier transform. 

In Chapter 3, we develop the z -transform as a generalization of the Fourier trans- 
form. This chapter focuses on developing the basic theorems and properties of the 
z -transform and the development of the partial fraction expansion method for the in- 
verse transform operation. In Chapter 5, the results developed in Chapters 3 and 4 are 
used extensively in a detailed discussion of the representation and analysis of linear 
time-invariant systems. 

In Chapter 4, we carry out a detailed discussion of the relationship between 
continuous-time and discrete-time signals when the discrete-time signals are obtained 
through periodic sampling of continuous -time signals. This includes a development of 
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the Nyquist sampling theorem. In addition, we discuss upsampling and downsampling 
of discrete-time signals, as used, for example, in multirate signal processing systems 
and for sampling rate conversion. The chapter concludes with a discussion of some of 
the practical issues encountered in conversion from continuous time to discrete time 
including prefiltering to avoid aliasing, modeling the effects of amplitude quantization 
when the discrete-time signals are represented digitally, and the use of oversampling in 
simplifying the A-to-D and D-to-A conversion processes. 

In Chapter 5 we apply the concepts developed in the previous chapters to a de- 
tailed study of the properties of linear time-invariant systems. We define the class of 
ideal, frequency-selective filters and develop the system function and pole-zero rep- 
resentation for systems described by linear constant-coefficient difference equations, 
a class of systems whose implementation is considered in detail in Chapter 6. Also in 
Chapter 5, we define and discuss group delay, phase response and phase distortion, 
and the relationships between the magnitude response and the phase response of sys- 
tems, including a discussion of minimum-phase, allpass, and generalized linear phase 
systems. 

In Chapter 6, we focus specifically on systems described by linear constant- 
coefficient difference equations and develop their representation in terms of block 
diagrams and linear signal flow graphs. Much of this chapter is concerned with develop- 
ing a variety of the important system structures and comparing some of their properties. 
The importance of this discussion and the variety of filter structures relate to the fact 
that in a practical implementation of a discrete-time system, the effects of coefficient 
inaccuracies and arithmetic error can be very dependent on the specific structure used. 
While these basic issues are similar whether the technology used for implementation 
is digital or discrete-time analog, we illustrate them in this chapter in the context of a 
digital implementation through a discussion of the effects of coefficient quantization 
and arithmetic roundoff noise for digital filters. 

While Chapter 6 is concerned with the representation and implementation of 
linear constant-coefficient difference equations, Chapter 7 is a discussion of the proce- 
dures for obtaining the coefficients of this class of difference equations to approximate 
a desired system response. The design techniques separate into those used for infinite 
impulse response (IIR) filters and those used for finite impulse response (FIR) filters. 

In continuous- time linear system theory, the Fourier transform is primarily an an- 
alytical tool for representing signals and systems. In contrast, in the discrete-time case, 
many signal processing systems and algorithms involve the explicit computation of the 
Fourier transform. While the Fourier transform itself cannot be computed, a sampled 
version of it, the discrete Fourier transform (DFT), can be computed, and for finite- 
length signals the DFT is a complete Fourier representation of the signal. In Chapter 8, 
the discrete Fourier transform is introduced and its properties and relationship to the 
discrete-time Fourier transform are developed in detail. In this chapter we also provide 
an introduction to the discrete cosine transform which is playing an increasingly impor- 
tant role in many applications including audio and video compression. In Chapter 9, 
the rich and important variety of algorithms for computing or generating the discrete 
Fourier transform is introduced and discussed, including the Goertzel algorithm, the 
fast Fourier transform (FFT) algorithms, and the chirp transform. 

With the background developed in the earlier chapters and particularly Chapters 2, 
3,5, and 8, we focus in Chapter 10 on Fourier analysis of signals using the discrete Fourier 
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transform. Without a careful understanding of the issues involved and the relationship 
between the DFT and the Fourier transform, using the DFT for practical signal analysis 
can often lead to confusions and misinterpretations. We address a number of these 
issues in Chapter 10. We also consider in some detail the Fourier analysis of signals with 
time-varying characteristics by means of the time-dependent Fourier transform. 

In Chapter 11, we introduce the discrete Hilbert transform. This transform arises 
in a variety of practical applications, including inverse filtering, complex representations 
for real bandpass signals, single-sideband modulation techniques, and many others. 

With this edition we thank and welcome Professor John Buck. John has been a 
long time contributor to this book through his teaching of the subject while a student at 
MIT and more recently as a member of the faculty at the University of Massachusetts 
Dartmouth. In this edition he has taken the major responsibility for a total reworking 
and reorganization of the homework problems and many of the examples in the book. 
His insight and dedication to the task are obvious in the final result. 

Alan V Oppenheim 
Ronald W. Schafer 
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Introduction 



Signal processing has a long and rich history. It is a technology that spans an immense set 
of disciplines including entertainment, communications, space exploration, medicine, 
and archaeology, just to name a few. Sophisticated signal processing algorithms and 
hardware are prevalent in a wide range of systems, from highly specialized military 
systems through industrial applications to low-cost, high-volume consumer electron- 
ics. Although we routinely take for granted the performance of home entertainment 
systems such as television and high-fidelity audio, these systems have always relied 
heavily on state-of-the-art signal processing. This is even more true today with the 
emergence of advanced television and multimedia entertainment and information sys- 
tems. Furthermore, as communication systems become increasingly wireless, mobile, 
and multifunctional, the importance of sophisticated signal processing in these systems 
continues to grow. Overall, as we look to the future, it is clear that the role of signal 
processing in our society is accelerating, driven in part by the convergence of communi- 
cations, computers and signal processing in both the consumer arena and in advanced 
industrial and government applications. 

The field of signal processing has always benefited from a close coupling between 
theory, applications, and technologies for implementing signal processing systems. The 
growing number of applications and demand for increasingly sophisticated algorithms 
goes hand-in-hand with the rapid pace of device technology for implementing signal 
processing systems. By some estimates the processing capability of signal processing 
microprocessors is likely to increase by a factor of 200 or more over the next ten years. 
It seems clear that in many ways the importance and role of signal processing is accel- 
erating and expanding. 

Signal processing is concerned with the representation, transformation, and ma- 
nipulation of signals and the information they contain. For example, we may wish to 
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separate two or more signals that have somehow been combined, or we may want to en- 
hance some signal component or some parameter of a signal model. In communications 
systems, it is generally necessary to do pre-processing such as modulation, signal condi- 
tioning, and compression prior to transmission over a channel and then to post process 
at the receiver. Prior to the 1960s, the technology for signal processing was almost ex- 
clusively continuous-time analog technology. 1 The rapid evolution of digital computers 
and microprocessors together with some important theoretical developments such as 
the fast Fourier transform algorithm (FFT) caused a major shift to digital technolo- 
gies, giving rise to the field of digital signal processing. A fundamental aspect of digital 
signal processing is that it is based on processing sequences of samples. This discrete- 
time nature of digital signal processing technology is also characteristic of other signal 
processing technologies such as surface acoustic wave (SAW) devices, charge-coupled 
devices (CCDs), charge transport devices (CTDs), and switched-capacitor technologies. 
In digital signal processing, signals are represented by sequences of finite-precision num- 
bers, and processing is implemented using digital computation. The more general term 
discrete-time signal processing includes digital signal processing as a special case, but also 
includes the possibility that sequences of samples (sampled data) are processed with 
other discrete-time technologies. Often the distinction between the terms discrete-time 
signal processing and digital signal processing is of minor importance, since both are 
concerned with discrete-time signals. While there are many examples in which signals 
to be processed are inherently sequences, most applications involve the use of discrete- 
time technology for processing continuous-time signals. In this case, a continuous-time 
signal is converted into a sequence of samples, i.e., a discrete-time signal. After discrete- 
time processing, the output sequence is converted back to a continuous-time signal. 
Real-time operation is often desirable for such systems, meaning that the discrete-time 
system is implemented so that samples of the output are computed at the same rate at 
which the continuous-time signal is sampled. Discrete-time processing of continuous- 
time signals in real time is commonplace in communication systems, radar and sonar, 
speech and video coding and enhancement, and biomedical engineering to name just 
a few. The compact disc player is a somewhat different example in which a processed 
form of the input is stored (on the compact disc) and final processing is carried out in 
real time when the output is desired. The compact disc recording and playback system 
relies on many of the signal processing concepts which we discuss in this book. 

Much of traditional signal processing involves processing one signal to obtain 
another signal. Another important class of signal processing problems is signal interpre- 
tation. In such problems the objective of the processing is not to obtain an output signal 
but to obtain a characterization of the input signal. For example, in a speech recognition 
or understanding system, the objective is to interpret the input signal or extract informa- 
tion from it. Typically, such a system will apply digital preprocessing (filtering, parameter 
estimation, etc.) followed by a pattern recognition system to produce a symbolic repre- 
sentation such as a phonemic transcription of the speech. This symbolic output can in 
turn be the input to a symbolic processing system, such as a rule-based expert system, to 

*In a general context, we typically refer to the independent variable as "time" even though in specific 
contexts the independent variable may take on any of a broad range of possible dimensions. Consequently, 
continuous time and discrete time should be thought of as generic terms referring to a continuous independent 
variable and a discrete independent variable, respectively. 
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provide the final signal interpretation. Still another and relatively new category of signal 
processing involves the symbolic manipulation of signal processing expressions. This 
type of processing is particularly useful in signal processing workstations and for the 
computer-aided design of signal processing systems. In this class of processing, signals 
and systems are represented and manipulated as abstract data objects. Object-oriented 
programming languages provide a convenient environment for manipulating signals, 
systems, and signal processing expressions without explicitly evaluating the data se- 
quences and provide the basis for this class of processing. The sophistication of systems 
designed to do signal expression processing is directly influenced by the incorporation 
of fundamental signal processing concepts, theorems, and properties such as those that 
form the basis for this book. For example, a signal processing environment that incor- 
porates the property that convolution in the time domain corresponds to multiplication 
in the frequency domain can explore a variety of rearrangements of filtering structures, 
including those involving the direct use of the discrete Fourier transform and the fast 
Fourier transform algorithm. Similarly, environments that incorporate the relationship 
between sampling rate and aliasing can make effective use of decimation and interpola- 
tion strategies for filter implementation. Similar ideas are currently being explored for 
implementing signal processing in network environments. In this type of environment, 
data can potentially be tagged with a high-level description of the processing to be 
done and the details of the implementation can be based dynamically on the resources 
available on the network. 

The development of object-oriented environments for computer-aided system 
design and for signal processing on dynamically changing networks is still in its very 
early stages and any detailed discussion of it is beyond the scope of this text. However, it 
is important to recognize that the basic concepts that are the subject of this book should 
not be viewed as just theoretical in nature; they are likely to become an explicit integral 
part of computer-aided signal processing environments, workstations, and networks. 

Many of the concepts and design techniques discussed in this text are now incorpo- 
rated into the structure of sophisticated software systems such as Matlab. In many cases 
where discrete-time signals are acquired and stored in computers, these tools allow ex- 
tremely sophisticated signal processing operations to be formed from basic functions. In 
such cases, it is not generally necessary to know the details of the underlying algorithm 
that implements the computation of an operation like the FFT, but it is essential to 
understand what is computed and how it should be interpreted. In other words, a good 
understanding of the concepts considered in this text is essential for intelligent use of 
the signal processing software tools that are now widely available. 

Signal processing problems are not confined, of course, to one-dimensional signals. 
Although there are some fundamental differences in the theories for one-dimensional 
and multidimensional signal processing, much of the material that we discuss in this text 
has a direct counterpart in multidimensional systems. The theory of multidimensional 
digital signal processing is presented in detail in Dudgeon and Mersereau (1984), Lim 
(1989), and Bracewell (1986). 2 Many image processing applications require the use of 
two-dimensional signal processing techniques. This is the case in such areas as video 
coding, medical imaging, enhancement and analysis of aerial photographs, analysis 

2 Authors names and dates are used throughout the text to refer to books and papers listed in the 
Bibliography at the end of the book. 
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of satellite weather photos, and enhancement of video transmissions from lunar and 
deep-space probes. Applications of multidimensional digital signal processing to image 
processing are discussed in Andrews and Hunt (1977), Macovski (1983), Pratt (1991), 
Castleman (1996), Jain (1989), and Chellappa et al. (1998). Seismic data analysis as 
required in oil exploration, earthquake measurement, and nuclear test monitoring also 
utilizes multidimensional signal processing techniques. Seismic applications are dis- 
cussed in Robinson and Treitel (1980) and Robinson and Durrani (1985). 

Multidimensional signal processing is only one of many advanced and specialized 
topics that build on the fundamentals covered in this text. Spectral analysis based on 
the use of the discrete Fourier transform and the use of signal modeling is another 
particularly rich and important aspect of signal processing. We introduce many facets 
of this topic, focusing on the basic concepts and techniques relating to the use of the 
discrete Fourier transform. In addition to these techniques, a variety of spectral analysis 
methods rely in one way or another on specific signal models. For example, a class of 
high-resolution spectral analysis methods referred to as maximum entropy methods 
(MEM spectral analysis) is based on representing the signal to be analyzed as the 
response of a discrete-time linear time-invariant filter to either an impulse or to white 
noise. Spectral analysis is achieved by estimating the parameters (e.g., the difference 
equation coefficients) of the system and then evaluating the magnitude squared of the 
frequency response of the model filter. A thorough and detailed treatment of the issues 
and techniques of this approach to signal modeling and spectral analysis builds directly 
from the fundamentals in this text. Detailed discussions can be found in the texts by Kay 
(1988), Marple (1987), and Hayes (1996). Signal modeling also plays an important role 
in data compression and coding, and again the fundamentals of difference equations 
provide the basis for understanding many of these techniques. For example, one class 
of signal coding techniques, referred to as linear predictive coding (LPC), exploits the 
notion that if a signal is the response of a certain class of discrete-time filters, the 
signal value at any time index is a linear function of (and thus linearly predictable 
from) previous values. Consequently, efficient signal representations can be obtained 
by estimating these prediction parameters and using them along with the prediction 
error to represent the signal. The signal can then be regenerated when needed from the 
model parameters. This class of signal coding techniques has been particularly effective 
in speech coding and is described in considerable detail in Jayant and Noll (1984), 
Markel and Gray (1976), Rabiner and Schafer (1978), and Deller et al. (1993). 

Another advanced topic of considerable importance is adaptive signal processing. 
Adaptive systems represent a particular class of time-varying and, in some sense, non- 
linear systems with broad application and with established and effective techniques for 
their design and analysis. Again, many of these techniques build from the fundamen- 
tals of discrete-time signal processing covered in this text. Details of adaptive signal 
processing are given by Haykin (1996), and Widrow and Stearns (1985). 

These represent only a few of the many advanced topics that extend from the topics 
covered in this text. Others include advanced and specialized filter design procedures, 
a variety of specialized algorithms for evaluation of the Fourier transform, specialized 
filter structures, and various advanced multirate signal processing techniques including 
filter banks and wavelet transforms. 

It is often said that the purpose of a fundamental textbook should be to uncover 
rather than cover a subject, and in choosing the topics and depth of coverage in this book 
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we have been guided by this philosophy. The preceding brief discussion of advanced 
topics and the Bibliography at the end of the book should be strongly suggestive of the 
rich variety of directions that these fundamentals begin to uncover. 



HISTORICAL PERSPECTIVE 

Discrete-time signal processing has advanced in uneven steps over a long period of 
time. Looking back at the development of the field provides a valuable perspective on 
fundamentals that will remain central to the field long into the future. Since the inven- 
tion of calculus in the 17th century, scientists and engineers have developed models to 
represent physical phenomena in terms of functions of continuous variables and differ- 
ential equations. Numerical techniques have been used to solve these equations when 
analytical solutions are not possible. Indeed, Newton used finite-difference methods 
that are special cases of some of the discrete-time systems that we present in this text. 
Mathematicians of the 18th century, such as Euler, Bernoulli, and Lagrange, developed 
methods for numerical integration and interpolation of functions of a continuous vari- 
able. Interesting historical research by Heideman, Johnson, and Burrus (1984) showed 
that Gauss discovered the fundamental principle of the fast Fourier transform (dis- 
cussed in Chapter 9) as early as 1805-even before the publication of Fourier's treatise 
on harmonic series representation of functions. 

Until the early 1950s, signal processing as we have defined it was typically done 
with analog systems that were implemented with electronic circuits or even with me- 
chanical devices. Even though digital computers were becoming available in business 
environments and in scientific laboratories, they were expensive and had relatively lim- 
ited capabilities. About that time, the need for more sophisticated signal processing in 
some application areas created considerable interest in discrete-time signal processing. 
One of the first uses of digital computers in digital signal processing was in oil prospect- 
ing, where seismic data could be recorded on magnetic tape for later processing. This 
type of signal processing could not generally be done in real time; minutes or even 
hours of computer time were often required to process only seconds of data. Even so, 
the flexibility of the digital computer and the potential payoffs made this alternative 
extremely inviting. 

Also in the 1950s, the use of digital computers in signal processing arose in a 
different way. Because of the flexibility of digital computers, it was often useful to sim- 
ulate a signal processing system on a digital computer before implementing it in analog 
hardware. In this way, a new signal processing algorithm or system could be studied 
in a flexible experimental environment before committing economic and engineering 
resources to constructing it. Typical examples of such simulations were the vocoder 
simulations carried out at Lincoln Laboratory and Bell Laboratories. In the implemen- 
tation of an analog channel vocoder, for example, the filter characteristics affected the 
perceived quality of the coded speech signal in ways that were difficult to quantify ob- 
jectively. Through computer simulations, these filter characteristics could be adjusted 
and the perceived quality of a speech coding system evaluated prior to construction of 
the analog equipment. 

In all of these examples of signal processing using digital computers, the computer 
offered tremendous advantages in flexibility. However, the processing could not be done 
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in real time. Consequently, a prevalent attitude was that the digital computer was being 
used to approximate, or simulate, an analog signal processing system. In keeping with 
that style, early work on digital filtering was very much concerned with ways in which a 
filter could be programmed on a digital computer so that with analog-to-digital conver- 
sion of the signal, followed by digital filtering, followed by digital-to-analog conversion, 
the overall system approximated a good analog filter. The notion that digital systems 
might, in fact, be practical for the actual real-time implementation of signal processing 
in speech communication, radar processing, or any of a variety of other applications 
seemed at the most optimistic times to be highly speculative. Speed, cost, and size were, 
of course, three of the important factors in favor of the use of analog components. 

As signals were being processed on digital computers, researchers had a natural 
tendency to experiment with increasingly sophisticated signal processing algorithms. 
Some of these algorithms grew out of the flexibility of the digital computer and had no 
apparent practical implementation in analog equipment. Thus, many of these algorithms 
were treated as interesting, but somewhat impractical, ideas. The development of such 
signal processing algorithms made the notion of all-digital implementation of signal 
processing systems even more tempting. Active work began on the investigation of 
digital vocoders, digital spectrum analyzers, and other all-digital systems, with the hope 
that eventually such systems would become practical. 

The evolution of a new point of view toward discrete-time signal processing was 
further accelerated by the disclosure by Cooley and Tukey (1965) of an efficient al- 
gorithm for computation of Fourier transforms. This class of algorithms has come to 
be known as the fast Fourier transform, or FFT. The FFT was significant for several 
reasons. Many signal processing algorithms that had been developed on digital com- 
puters required processing times several orders of magnitude greater than real time. 
Often this was because spectrum analysis was an important component of the signal 
processing and no efficient means were available for implementing it. The fast Fourier 
transform algorithm reduced the computation time of the Fourier transform by orders 
of magnitude, permitting the implementation of increasingly sophisticated signal pro- 
cessing algorithms with processing times that allowed interactive experimentation with 
the system. Furthermore, with the realization that the fast Fourier transform algorithms 
might, in fact, be implementable in special-purpose digital hardware, many signal pro- 
cessing algorithms that previously had appeared to be impractical began to appear to 
have practical implementations. 

Another important implication of the fast Fourier transform algorithm was that 
it was an inherently discrete-time concept. It was directed toward the computation of 
the Fourier transform of a discrete-time signal or sequence and involved a set of prop- 
erties and mathematics that was exact in the discrete-time domain-it was not simply 
an approximation to a continuous-time Fourier transform. This had the effect of stim- 
ulating a reformulation of many signal processing concepts and algorithms in terms of 
discrete-time mathematics, and these techniques then formed an exact set of relation- 
ships in the discrete-time domain. Following this shift away from the notion that signal 
processing on a digital computer was merely an approximation to analog signal pro- 
cessing techniques, there emerged a strong interest in discrete-time signal processing 
as an important field of investigation in its own right. 

Another major development in the history of discrete- time signal processing 
occurred in the field of microelectronics. The invention and subsequent proliferation of 
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the microprocessor paved the way for low-cost implementations of discrete-time signal 
processing systems. Although the first microprocessors were too slow to implement 
most discrete-time systems in real time, by the mid-1980s integrated circuit technology 
had advanced to a level that permitted the implementation of very fast fixed-point and 
floating-point microcomputers with architectures specially designed for implementing 
discrete-time signal processing algorithms. With this technology came, for the first time, 
the possibility of widespread application of discrete-time signal processing techniques. 



FUTURE PROMISE 

Microelectronics engineers continue to strive for increased circuit densities and pro- 
duction yields, and as a result, the complexity and sophistication of microelectronic 
systems are continually increasing. Indeed, complexity and capability of DSP chips 
have grown exponentially since the early 1980s and show no sign of slowing down. As 
wafer-scale integration techniques become highly developed, very complex discrete- 
time signal processing systems will be implemented with low cost, miniature size, and 
low power consumption. Consequently, the importance of discrete-time signal pro- 
cessing will almost certainly continue to increase and the future development of the 
field is likely to be even more dramatic than the course of development that we have 
just described. Discrete-time signal processing techniques are already promoting rev- 
olutionary advances in some fields of application. A notable example is in the area of 
telecommunications, where discrete-time signal processing techniques, microelectronic 
technology, and fiber optic transmission combine to change the nature of communica- 
tion systems in truly revolutionary ways. A similar impact can be expected in many 
other areas of technology. 

While discrete-time signal processing is a dynamic, rapidly growing field, its funda- 
mentals are well formulated. Our goal in this book is to provide a coherent treatment of 
the theory of discrete-time linear systems, filtering, sampling, and discrete-time Fourier 
analysis. The topics presented should provide the reader with the knowledge necessary 
for an appreciation of the wide scope of applications for discrete-time signal process- 
ing and a foundation for contributing to future developments in this exciting field of 
technology. 






Discrete-time signals 

and systems 



2.0 INTRODUCTION 

The term signal is generally applied to something that conveys information. Signals 
generally convey information about the state or behavior of a physical system, and 
often, signals are synthesized for the purpose of communicating information between 
humans or between humans and machines. Although signals can be represented in many 
ways, in all cases the information is contained in some pattern of variations. Signals are 
represented mathematically as functions of one or more independent variables. For 
example, a speech signal is represented mathematically as a function of time, and a 
photographic image is represented as a brightness function of two spatial variables. A 
common convention — and one that usually will be followed in this book — is to refer 
to the independent variable of the mathematical representation of a signal as time, 
although in specific examples the independent variable may in fact not represent time. 

The independent variable in the mathematical representation of a signal may be 
either continuous or discrete. Continuous-time signals are defined along a continuum 
of times and thus are represented by a continuous independent variable. Continuous- 
time signals are often referred to as analog signals. Discrete-time signals are defined at 
discrete times, and thus, the independent variable has discrete values; i.e., discrete-time 
signals are represented as sequences of numbers. Signals such as speech or images may 
have either a continuous- or a discrete-variable representation, and if certain conditions 
hold, these representations are entirely equivalent. Besides the independent variables 
being either continuous or discrete, the signal amplitude may be either continuous or 
discrete. Digital signals are those for which both time and amplitude are discrete. 

Signal-processing systems may be classified along the same lines as signals. That 
is, continuous-time systems are systems for which both the input and the output are 
8 
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continuous-time signals, and discrete-time systems are those for which both the input 
and the output are discrete-time signals. Similarly, a digital system is a system for which 
both the input and the output are digital signals. Digital signal processing, then, deals 
with the transformation of signals that are discrete in both amplitude and time. The 
principal focus in this book is on discrete-time (rather than digital) signals and systems. 
However, the theory of discrete-time signals and systems is also exceedingly useful for 
digital signals and systems, particularly if the signal amplitudes are finely quantized. The 
effects of signal amplitude quantization are considered in Sections 4.8, 6.7-6.9, and 9.7. 

Discrete-time signals may arise by sampling a continuous-time signal, or they may 
be generated directly by some discrete-time process. Whatever the origin of the discrete- 
time signals, discrete-time signal-processing systems have many attractive features. They 
can be realized with great flexibility with a variety of technologies, such as charge 
transport devices, surface acoustic wave devices, general-purpose digital computers, or 
high-speed microprocessors. Complete signal-processing systems can be implemented 
using VLSI techniques. Discrete-time systems can be used to simulate analog systems 
or, more importantly, to realize signal transformations that cannot be implemented 
with continuous-time hardware. Thus, discrete-time representations of signals are often 
desirable when sophisticated and flexible signal processing is required. 

In this chapter, we consider the fundamental concepts of discrete-time signals and 
signal-processing systems for one-dimensional signals. We emphasize the class of linear 
time-invariant discrete-time systems. Many of the properties and results that we derive 
in this and subsequent chapters will be similar to properties and results for linear time- 
invariant continuous-time systems, as presented in a variety of texts. (See, for example, 
Oppenheim and Willsky, 1997.) In fact, it is possible to approach the discussion of 
discrete-time systems by treating sequences as analog signals that are impulse trains. This 
approach, if implemented carefully, can lead to correct results and has formed the basis 
for much of the classical discussion of sampled data systems. (See, for example, Phillips 
and Nagle, 1995.) However, not all sequences arise from sampling a continuous-time 
signal, and many discrete-time systems are not simply approximations to corresponding 
analog systems. Furthermore, there are important and fundamental differences between 
discrete- and continuous-time systems. Therefore, rather than attempt to force results 
from continuous-time system theory into a discrete-time framework, we will derive 
parallel results starting within a framework and with notation that is suitable to discrete- 
time systems. Discrete-time signals will be related to continuous-time signals only when 
it is necessary and useful to do so. 

2.1 DISCRETE-TIME SIGNALS: SEQUENCES 

Discrete-time signals are represented mathematically as sequences of numbers. A se- 
quence of numbers x, in which the nth number in the sequence is denoted x[n\} is 
formally written as 

x = [x[n]}, — oo < n < oo, (2.1) 

where n is an integer. In a practical setting, such sequences can often arise from periodic 

1 A sequence is simply a function whose domain is the set of integers. Note that we use [ ] to enclose 
the independent variable of such functions, and we use ( ) to enclose the independent variable of continuous- 
variable functions. 
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sampling of an analog signal In this case, the numeric value of the nth number in the 
sequence is equal to the value of the analog signal, x a (t), at time nT; i.e., 



x[n] = x a (nT), 



— oo < n < oo. 



(2.2) 



The quantity T is called the sampling period, and its reciprocal is the sampling fre- 
quency. Although sequences do not always arise from sampling analog waveforms, it is 
convenient to refer to x[ri\ as the "nth sample" of the sequence. Also, although, strictly 
speaking, x[n] denotes the nth number in the sequence, the notation of Eq. (2.1) is often 
unnecessarily cumbersome, and it is convenient and unambiguous to refer to "the se- 
quence x [n] " when we mean the entire sequence, just as we referred to the "analog signal 
jc fl (f)." Discrete-time signals (i.e., sequences) are often depicted graphically as shown in 
Figure 2.1. Although the abscissa is drawn as a continuous line, it is important to recog- 
nize that x[n] is denned only for integer values of n, It is not correct to think of x[n] as 
being zero for n is not an integer; x[n] is simply undefined for noninteger values of n. 
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Figure 2.1 Graphical representation of 
a discrete-time signal. 



As an example, Figure 2.2(a) shows a segment of a speech signal corresponding to 
acoustic pressure variation as a function of time, and Figure 2.2(b) presents a sequence 
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Figure 2.2 (a) Segment of a continuous-time speech signal, (b) Sequence of samples 
obtained from part (a) with T = 125 /zs. 
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of samples of the speech signal. Although the original speech signal is denned at all 
values of time t, the sequence contains information about the signal only at discrete 
instants. From the sampling theorem, discussed in Chapter 4, the original signal can be 
reconstructed as accurately as desired from a corresponding sequence of samples if the 
samples are taken frequently enough. 

2.1.1 Basic Sequences and Sequence Operations 

In the analysis of discrete-time signal-processing systems, sequences are manipulated 
in several basic ways. The product and sum of two sequences x[n] and y[n] are defined 
as the sample-by-sample product and sum, respectively. Multiplication of a sequence 
x[n] by a number a is defined as multiplication of each sample value by a. A sequence 
y[n] is said to be a delayed or shifted version of a sequence x[n] if 

y[n] = x[n - n ], (2.3) 

where no is an integer. 

In discussing the theory of discrete-time signals and systems, several basic se- 
quences are of particular importance. These sequences are shown in Figure 2.3 and are 
discussed next. 

The unit sample sequence (Figure 2.3a) is defined as the sequence 

%] = {?; n n t° [ (2.4) 

As we will see, the unit sample sequence plays the same role for discrete-time signals and 
systems that the unit impulse function (Dirac delta function) does for continuous-time 
signals and systems. For convenience, the unit sample sequence is often referred to as a 
discrete-time impulse or simply as an impulse. It is important to note that a discrete-time 
impulse does not suffer from the mathematical complications of the continuous-time 
impulse; its definition is simple and precise. 

As we will see in the discussion of linear systems, one of the important aspects 
of the impulse sequence is that an arbitrary sequence can be represented as a sum of 
scaled, delayed impulses. For example, the sequence p[n] in Figure 2.4 can be expressed 
as 

p[n] = a- 3 S[n + 3] + ai&[n - 1] + a 2 S[n - 2] + a 7 S[n - 7]. (2.5) 

More generally, any sequence can be expressed as 



00 



x[n]= J2 x[k]S[n-k]. (2.6) 



fc=-00 



We will make specific use of Eq. (2.6) in discussing the representation of discrete-time 
linear systems. 

The unit step sequence (Figure 2.3b) is given by 

r i f 1. n > 0, ( v 

M M = (o, *<0. < 2 ' 7 > 
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Figure 2.3 Some basic sequences. 
The sequences shown play important 
roles in the analysis and representation 
of discrete-time signals and systems. 
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Figure 2.4 Example of a sequence to 
be represented as a sum of scaled, 
delayed impulses. 



The unit step is related to the impulse by 



k=— 00 



(2.8) 



that is, the value of the unit step sequence at (time) index n is equal to the accumulated 
sum of the value at index n and all previous values of the impulse sequence. An alterna- 
tive representation of the unit step in terms of the impulse is obtained by interpreting 



Sec. 2.1 Discrete-Time Signals: Sequences 13 

the unit step in Figure 2.3(b) in terms of a sum of delayed impulses as in Eq. (2.6). In 
this case, the nonzero values are all unity, so 

u[n] = &[n] + 8[n - 1] + 8[n - 2] + • . . (2.9a) 

or 

oo 

u[n] = ^2s[n-k]. (2.9b) 

Conversely, the impulse sequence can be expressed as the first backward difference of 
the unit step sequence, i.e., 

S[n] = u[n] - u[n - 1]. (2.10) 

Exponential sequences are extremely important in representing and analyzing lin- 
ear time-invariant discrete-time systems. The general form of an exponential sequence 

is 

x[n] = Aa n . (2.11) 

If A and a are real numbers, then the sequence is real. If < a < 1 and A is positive, 
then the sequence values are positive and decrease with increasing k, as in Figure 2.3(c). 
For — 1 < a < 0, the sequence values alternate in sign, but again decrease in magnitude 
with increasing n. If |a| > 1, then the sequence grows in magnitude as n increases. 

Example 2.1 Combining Basic Sequences 

We often combine basic sequences to form simple representations of other sequences. 
If we want an exponential sequence that is zero for n < 0, we can write this as the 
somewhat cumbersome expression 

ri ( Act", «>0, ( , 

*M = \ 0, n < 0. (212) 

A much simpler expression is x[n] — Aa n u[n]. 

Sinusoidal sequences are also very important. A sinusoidal sequence has the gen- 
eral form 

x[n] = A cos(o»ort + 0), for all n, (2.13) 

with A and <j> real constants, and is illustrated in Figure 2.3(d). 

The exponential sequence Aot n with complex a has real and imaginary parts that 
are exponentially weighted sinusoids. Specifically, if a = |a|e ;tt>0 and A = \A\eM, the 
sequence Act" can be expressed in any of the following ways: 

x[n] = Aa n = \A\e j<p \a\ n e ia)Qn 

= I^HalV^ "^ (2.14) 

= \A\ |Qr|"cos(<y O " + 0) + j\A\ \a\ n sm(co Q n-\-(p). 
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The sequence oscillates with an exponentially growing envelope if |a| > 1 or with an 
exponentially decaying envelope if \a\ < 1. (As a simple example, consider the case 

COq = 7T.) 

When \a\ = 1, the sequence is referred to as a complex exponential sequence and 
has the form 

x[n] = \A\e j{(OQn+<l>) = \A\ cos(co n + 0) + j\A\ sin(co n + </>); (2.15) 

that is, the real and imaginary parts of e ] W{sn vary sinusoidally with n. By analogy with the 
continuous-time case, the quantity coo is called the frequency of the complex sinusoid or 
complex exponential, and <j> is called the phase. However, note that n is a dimensionless 
integer. Thus, the dimension of coo must be radians. If we wish to maintain a closer 
analogy with the continuous-time case, we can specify the units of coo to be radians per 
sample and the units of n to be samples. 

The fact that n is always an integer in Eq. (2.15) leads to some important differences 
between the properties of discrete- time and continuous-time complex exponential se- 
quences and sinusoidal sequences. An important difference between continuous-time 
and discrete-time complex sinusoids is seen when we consider a frequency (coq + 2tt). 
In this case, 

x\n\ = Ae^ m+27t > 

. , (2.16) 

More generally, we can easily see that complex exponential sequences with frequencies 
(coo + 27rr), where r is an integer, are indistinguishable from one another. An identical 
statement holds for sinusoidal sequences. Specifically, it is easily verified that 

x\n] — A cosHcoq + 2nr)n + d>] 
l J lv j yi (2 17) 

= A cos(&>ort + 0). 

The implications of this property for sequences obtained by sampling sinusoids and 
other signals will be discussed in Chapter 4. For now, we simply conclude that, when 
discussing complex exponential signals of the form x[n] = Ae^ " or real sinusoidal 
signals of the form x[n] = A cos(coon + <p) 7 we need only consider frequencies in an 
interval of length 2tt, such as — tt < coo < n or < coo <2tt. 

Another important difference between continuous-time and discrete-time com- 
plex exponentials and sinusoids concerns their periodicity. In the continuous-time case, 
a sinusoidal signal and a complex exponential signal are both periodic, with the period 
equal to 2n divided by the frequency. In the discrete -time case, a periodic sequence is 
a sequence for which 

x[n] = x[n + N], for all n, (2.18) 

where the period N is necessarily an integer. If this condition for periodicity is tested 
for the discrete-time sinusoid, then 

A cos(coon + </») = A cos(coon + coqN + <f>), (2.19) 

which requires that 

co N = 27zk, (2.20) 

where k is an integer. A similar statement holds for the complex exponential sequence 
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Ce ;G, °"; that is, periodicity with period N requires that 

which is true only for coqN = 2tt/c, as in Eq. (2.20). Consequently, complex exponential 
and sinusoidal sequences are not necessarily periodic in n with period (2n/(oo) and, 
depending on the value of coo, may not be periodic at all. 

Example 2.2 Periodic and Aperiodic Discrete-Time 
Sinusoids 

Consider the signal jci [n] = cos(;rn/4). This signal has a period of N = 8. To show 
this, note that x[n + 8] = cos(n(n + 8)/4) = cos(^/i/4 + In) = cos(;m/4) = x[n], 
satisfying the definition of a discrete-time periodic signal. Contrary to our intuition 
from continuous-time sinusoids, increasing the frequency of a discrete-time sinusoid 
does not necessarily decrease the period of the signal. Consider the discrete-time 
sinusoid X2M = cos(3^«/8), which has a higher frequency than x\[ri\. However, X2[n] 
is not periodic with period 8, since X2[n + 8] = cos(3^(n + 8)/8) = cos(3^n/8 + 3tt) = 
— X2[n], Using an argument analogous to the one for x\ [n], we can show that X2[n] has 
a period of N — 16. Thus, increasing the frequency from coo = 2^/8 to coq — 3tt/8 
also increases the period of the signal. This occurs because discrete-time signals are 
defined only for integer indices n. 

The integer restriction on n causes some sinusoidal signals not to be periodic 
at all. For example, there is no integer N such that the signal x^ln] = cos(n) satisfies 
the condition x^[n + N] — x^[n] for all n. These and other properties of discrete-time 
sinusoids that run counter to their continuous-time counterparts are caused by the 
limitation of the time index n to integers for discrete-time signals and systems. 

When we combine the condition of Eq. (2.20) with our previous observation that 
coq and (coq + 2nr) are indistinguishable frequencies, it becomes clear that there are 
N distinguishable frequencies for which the corresponding sequences are periodic with 
period N. One set of frequencies is co^ = 2nk/N, k — 0, 1, . . . , N — 1. These properties 
of complex exponential and sinusoidal sequences are basic to both the theory and the 
design of computational algorithms for discrete-time Fourier analysis, and they will be 
discussed in more detail in Chapters 8 and 9. 

Related to the preceding discussion is the fact that the interpretation of high 
and low frequencies is somewhat different for continuous-time and discrete-time sinu- 
soidal and complex exponential signals. For a continuous- time sinusoidal signal x(t) = 
A cos(QQt + <p) y as Q increases, x(t) oscillates more and more rapidly. For the discrete- 
time sinusoidal signal x[n] = Acos(a)on + 0), as coq increases from a>o = toward 
coo = 7T, x[n] oscillates more and more rapidly. However, as coo increases from coo = n 
to coo = 2tt, the oscillations become slower. This is illustrated in Figure 2.5. In fact, be- 
cause of the periodicity in coo of sinusoidal and complex exponential sequences, co = 2jt 
is indistinguishable from coo = 0, and, more generally, frequencies around coo = 2jt are 
indistinguishable from frequencies around coo = 0. As a consequence, for sinusoidal 
and complex exponential signals, values of co in the vicinity of co = lirkfor any integer 
value of A: are typically referred to as low frequencies (relatively slow oscillations), while 
values of coo in the vicinity of coq = {it + 2nk) for any integer value of k are typically 
referred to as high frequencies (relatively rapid oscillations). 
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2.2 DISCRETE-TIME SYSTEMS 



Figure 2.5 cos co Q n for several 
different values of coq. As coo increases 
from zero toward n (parts a-d), the 
sequence oscillates more rapidly. As coq 
increases from n to 2n (parts d-a), the 
oscillations become slower. 



A discrete-time system is defined mathematically as a transformation or operator that 
maps an input sequence with values x[n] into an output sequence with values y[n]. This 
can be denoted as 



y[n] = T{x[n]} 



(2.22) 
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Figure 2.6 Representation of a 
discrete-time system, i.e., a 
transformation that maps an input 
sequence x[n] into a unique output 
sequence yjrtj. 



and is indicated pictorially in Figure 2.6. Equation (2.22) represents a rule or formula 
for computing the output sequence values from the input sequence values. It should 
be emphasized that the value of the output sequence at each value of the index n may 
depend on x[n] for all values of n. The following examples illustrate some simple and 
useful systems. 



Example 2.3 The Ideal Delay System 

The ideal delay system is defined by the equation 



(2.23) 



y[n] = x[n — rid], — oo < n < oo, 

where rid is a fixed positive integer called the delay of the system. In words, the ideal 
delay system simply shifts the input sequence to the right by rid samples to form the 
output. If, in Eq. (2.23), rid is a fixed negative integer, then the system would shift the 
input to the left by \tid\ samples, corresponding to a time advance. 



In Example 2.3, only one sample of the input sequence is involved in determining 
a certain output sample. In the following example, this is not the case. 



Example 2.4 Moving Average 

The general moving-average system is defined by the equation 

1 

k=-Mi 

[x[n + Mi] + x[n + M\ - 1] + • • ■ + x[n] 



M 2 



y[n] = 



Mi + M 2 + 
1 



T £ *[„-*] 



Mi + M 2 + 1 

+ *[n-l]+ •+x[n-M 2 ]}. 



(2.24) 
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Figure 2.7 Sequence values involved in computing a causal moving average. 

This system computes the nth sample of the output sequence as the average of (Mi + 
M 2 + 1) samples of the input sequence around the nth sample. Figure 2.7 shows an 
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input sequence plotted as a function of a dummy index k and the samples involved in 
the computation of the output sample y[n] for n = 7, M\ = 0, and M 2 — 5. The output 
sample y[7] is equal to one-sixth of the sum of all the samples between the vertical 
dotted lines. To compute v[8], both dotted lines would move one sample to the right. 

Classes of systems are defined by placing constraints on the properties of the 
transformation T {*}. Doing so often leads to very general mathematical representations, 
as we will see. Of particular importance are the system constraints and properties, 
discussed in Sections 2.2.1-2.2.5. 

2.2.1 Memory less Systems 

A system is referred to as memoryless if the output y[n] at every value of n depends 
only on the input x[n] at the same value of n. 

Example 2.5 A Memoryless System 

An example of a memoryless system is a system for which x[n] and y[n] are related by 

y[n] = (jc[/i]) 2 , for each value of n. (2.25) 

The system in Example 2.3 is not memoryless unless rid = 0; in particular, this system 
is referred to as having "memory" whether rid is positive (a time delay) or negative 
(a time advance). The system in Example 2.4 is not memoryless unless Mi = M 2 = 0. 

2.2.2 Linear Systems 

The class of linear systems is defined by the principle of superposition. If y\ [n] and y 2 [n] 
are the responses of a system when X\[ri\ and X2[n] are the respective inputs, then the 
system is linear if and only if 

T{ Xl [n] + x 2 [n]} = T{x 2 [n]} + T{x 2 [n]} = yi [n] + y 2 [n] (2.26a) 

and 

T{ax[n]} = aT{x[n]} = ay[n], (2.26b) 

where a is an arbitrary constant. The first property is called the additivity property, and 
the second is called the homogeneity or scaling property. These two properties can be 
combined into the principle of superposition, stated as 

T{ax![n] + bx 2 [n]} = aT{xi[n]) + bT{x 2 [n]} (2.27) 

for arbitrary constants a and b. This equation can be generalized to the superposition 
of many inputs. Specifically, if 

x[n] = ^2a k x k [n], (2.28a) 

k 

then the output of a linear system will be 

y[n] = J2a k y k [nl (2.28b) 

k 

where y k [n] is the system response to the input x k [n]. 

By using the definition of the principle of superposition, we can easily show that 
the systems of Examples 2.3 and 2.4 are linear systems. (See Problem 2.23.) An example 
of a nonlinear system is the system in Example 2.5. 
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Example 2.6 The Accumulator System 

The system defined by the input-output equation 

n 

k=—oo 

is called the accumulator system, since the output at time n is just the sum of the present 
and all previous input samples. The accumulator system is a linear system. In order to 
prove this, we must show that it satisfies the superposition principle for all inputs, not 
just any specific set of inputs. We begin by defining two arbitrary inputs x\ [n] and X2[n] 
and their corresponding outputs 

n 

k=~oo 
n 

V2W = J2 X2 W- < 2 - 31 ) 



k=—<x> 



When the input is ^[n] = a*i[n] + 2>JC2[n]> tne superposition principle requires the 
output V3[n] = a vi [n] + &V2M for all possible choices of a and b. We can show this by 
starting from Eq. (2.29): 



k=—oo 


(2.32) 


n 

= 5Z (axi[k] + bx 2 [k]), 
k=—oo 


(2.33) 


n n 


(2.34) 


k=—oo k=—oo 




-ayi[n]-\-by 2 [n\ 


(2.35) 



Thus, the accumulator system of Eq. (2.29) satisfies the superposition principle for all 
inputs and is therefore linear. 

In general, it may be simpler to prove that a system is not linear (if it is not) than 
to prove that it is linear (if it is). We simply must find an input or set of inputs for which 
the system does not satisfy the conditions of linearity. 

Example 2.7 A Nonlinear System 

Consider the system defined by 

H>[n] = log 10 (|*Ml). (2-36) 

This system is not linear. In order to prove this, we only need to find one 
counterexample — that is, one set of inputs and outputs which demonstrates that the sys- 
tem violates the superposition principle, Eq. (2,27). The inputs x\[ri\ = land^M = 10 
are a counterexample. The output for the first signal is w\ [n] = 0, while for the second, 
W2[n] = 1. The scaling property of linear systems requires that, since X2 [n] = 10jti[rc], 
if the system is linear, it must be true that W2[n] — 10wi[«]. Since this is not so for 
Eq. (2.36) for this set of inputs and outputs, the system is not linear. 
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2.2.3 Time-Invariant Systems 

A time-invariant system (often referred to equivalently as a shift-invariant system) is 
a system for which a time shift or delay of the input sequence causes a corresponding 
shift in the output sequence. Specifically, suppose that a system transforms the input 
sequence with values x[n] into the output sequence with values y[n]. Then the system is 
said to be time invariant if, for all no, the input sequence with values x^[n] = x[n — no] 
produces the output sequence with values yi[n] = y[n — no]. 

As in the case of linearity, proving that a system is time invariant requires a general 
proof making no specific assumptions about the input signals. All of the systems in 
Examples 2.3-2.7 are time invariant. The style of proof for time invariance is illustrated 
in Examples 2.8 and 2.9. 

Example 2.8 The Accumulator as a Time-Invariant System 

Consider the accumulator from Example 2.6. We define x\[n] = x[n — no]. To show 
time invariance, we solve for both y[n— no] and y i [n] and compare them to see whether 
they are equal. First, 

n-np 

k=—oo 

Next, we find 

n 

yiH = Yl X1 ^ < 238 ) 

k=-oo 
n 

= 5^ *[* - "oi- ( 2 - 39 ) 

k=-oo 

Substituting the change of variables k\ — k — no into the summation gives 

n—riQ 

viW= J^ *[*i] = y[« - «o]. (2.40) 

fci=-oo 

Thus, the accumulator is a time -invariant system. 
The following example illustrates a system that is not time invariant. 

Example 2.9 The Compressor System 

The system defined by the relation 

y[n] = x[Mn], — oo < n < oo, (2.41) 

with M a positive integer, is called a compressor. Specifically, it discards (M — 1) 
samples out of M; i.e., it creates the output sequence by selecting every Mth sample. 
This system is not time invariant. We can show that it is not by considering the response 
yi[n] to the input xi[n] = x[n — no]. In order for the system to be time invariant, the 
output of the system when the input is xi[n] must be equal to y[n — no]. The output 
yi [n] that results from the input *i[rt] can be directly computed from Eq. (2.41) to be 

yi[n] = x\[Mn] = x[Mn — no]. (2.42) 
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Delaying the output y[n] by no samples yields 

y[n - no] = x[M(n - no)]. (2.43) 

Comparing these two outputs, we see that y[n — no] is not equal to y\ [n] for all M and 
no, and therefore, the system is not time invariant. 

It is also possible to prove that a system is not time invariant by finding a single 
counterexample that violates the time-invariance property. For instance, a counterex- 
ample for the compressor is the case when M = 2, x[n] = 8[n], and x\[n] = 8[n — 1]. 
For this choice of inputs and M, v[n] = 8[n], but yi[n] = 0; thus, it is clear that 
yi[n] 7^ v[n — 1] for this system. 



2.2.4 Causality 

A system is causal if, for every choice of no, the output sequence value at the index n = n§ 
depends only on the input sequence values for n < i%. This implies that if x\[n] — X2[n] 
for n < no, then yi[n] = yi[n\ for n < no. That is, the system is nonanticipative. The 
system of Example 2.3 is causal for ai^ > and is noncausal for nd < 0. The system of 
Example 2.4 is causal if —Mi > and Mi > 0; otherwise it is noncausal. The system of 
Example 2.5 is causal, as is the accumulator of Example 2.6 and the nonlinear system 
in Example 2.7. However, the system of Example 2.9 is noncausal if M > 1, since 
v[l] = #[M]. Another noncausal system is given in the following example. 

Example 2.10 The Forward and Backward Difference 
Systems 

Consider the forward difference system defined by the relationship 

y[n] = x[n + 1] - x[n]. (2.44) 

This system is not causal, since the current value of the output depends on a future 
value of the input. The violation of causality can be demonstrated by considering the 
two inputs x\[n] = <5[n — 1] and xi[n] = and their corresponding outputs yi[n] = 
8[n] — 8[n — 1] and yi[n] = 0. Note that x\[n] = X2\n] for n < 0, so the definition of 
causality requires that y\ [n] = yi[ri\ for n < 0, which is clearly not the case for n = 0. 
Thus, by this counterexample, we have shown that the system is not causal. 
The backward difference system, defined as 

y[n] = jc[n]-jt[n-l], (2.45) 

has an output that depends only on the present and past values of the input. Because 
there is no way for the output at a specific time y[«o] to incorporate values of the input 
for n > no, the system is causal. 



2.2.5 Stability 

A system is stable in the bounded-input, bounded-output (BIBO) sense if and only if 
every bounded input sequence produces a bounded output sequence. The input x[n] is 
bounded if there exists a fixed positive finite value B x such that 

\x[n]\ < B x < oo, for all n. (2.46) 
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Stability requires that, for every bounded input, there exist a fixed positive finite value 
By such that 

\y[n]\ < By < oo, for all n. (2.47) 

It is important to emphasize that the properties we have defined in this section are 
properties of systems, not of the inputs to a system. That is, we may be able to find 
inputs for which the properties hold, but the existence of the property for some inputs 
does not mean that the system has the property. For the system to have the property, it 
must hold for all inputs. For example, an unstable system may have some bounded inputs 
for which the output is bounded, but for the system to have the property of stability, it 
must be true that for all bounded inputs, the output is bounded. If we can find just one 
input for which the system property does not hold, then we have shown that the system 
does not have that property. The following example illustrates the testing of stability 
for several of the systems that we have defined. 

Example 2.1 1 Testing for Stability or Instability 

The system of Example 2.5 is stable. To see this, assume that the input x[n] is bounded 
such that \x[n]\ < B x for all n. Then \y[n]\ = |*[n]| 2 < B\. Thus, we can choose 
By = Bl and prove that y[n] is bounded. 

Likewise, we can see that the system defined in Example 2.7 is unstable, since 
y[n] — log 10 (|jc[/i]|) = — oo for any values of the time index n at which x[n] = 0, even 
though the output will be bounded for any input samples that are not equal to zero. 

The accumulator, as defined in Example 2.6 by Eq. (2.29), is also not stable. For 
example, consider the case when x[n] = u[n] y which is clearly bounded by B x = 1. For 
this input, the output of the accumulator is 



y[n] = J2 U W (2-48) 

(2.49) 



k=— oo 

JO, n < 0, 

i(/i + l), «>0. 



There is no finite choice for B y such that (n + 1) < B y < oo for all n; thus, the system 
is unstable. 

Using similar arguments, it can be shown that the systems in Examples 2.3, 2.4, 
2.9 and 2.10 are all stable. 



2.3 LINEAR TIME-INVARIANT SYSTEMS 

A particularly important class of systems consists of those that are linear and time invari- 
ant. These two properties in combination lead to especially convenient representations 
for such systems. Most important, this class of systems has significant signal-processing 
applications The class of linear systems is defined by the principle of superposition in 
Eq. (2.27). If the linearity property is combined with the representation of a general 
sequence as a linear combination of delayed impulses as in Eq. (2.6), it follows that a 
linear system can be completely characterized by its impulse response. Specifically, let 
hk[n] be the response of the system to S[n — k], an impulse occurring at n — k. Then, 
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from Eq. (2.6), 

y [n] = T I ]T x[k]8[n - k] I . (2.50) 

U=-oo J 

From the principle of superposition in Eq. (2.27), we can write 

oo oo 

y[n]= ]T x[k]T{8[n-k]}= ]T x[k]h k [n]. (2.51) 

k=— oo k=— oo 

According to Eq. (2.51), the system response to any input can be expressed in terms of 
the responses of the system to the sequences 8[n — k]. If only linearity is imposed, h/c[n] 
will depend on both n and k, in which case the computational usefulness of Eq. (2.51) 
is limited. We obtain a more useful result if we impose the additional constraint of time 
invariance. 

The property of time invariance implies that if h[n] is the response to 8[n], then 
the response to 8[n — k] is h[n — k]. With this additional constraint, Eq. (2.51) becomes 

oo 

y [n]= ]T x[k]h[n-k]. (2.52) 

k=— oo 

As a consequence of Eq. (2.52), a linear time -invariant system (which we will sometimes 
abbreviate as LTI) is completely characterized by its impulse response h[n] in the sense 
that, given h[n], it is possible to use Eq. (2.52) to compute the output y[n] due to any 
input x[n]. 

Equation (2.52) is commonly called the convolution sum. If y[n] is a sequence 
whose values are related to the values of two sequences h[n] and x[n] as in Eq. (2.52), 
we say that y[n] is the convolution of x[n] with h[n] and represent this by the notation 

y[n] = x[n]*h[n]. (2.53) 

The operation of discrete-time convolution takes two sequences x[n] and h[n] and 
produces a third sequence y[ri\. Equation (2.52) expresses each sample of the output 
sequence in terms all of the samples of the input and impulse response sequences. 

The derivation of Eq. (2.52) suggests the interpretation that the input sample 
at n = k, represented as x[A;]5[n — k], is transformed by the system into an output 
sequence jc[/c]/*[/z — k], for — oo < n < oo, and that, for each k, these sequences are 
superimposed to form the overall output sequence. This interpretation is illustrated 
in Figure 2.8, which shows an impulse response, a simple input sequence having three 
nonzero samples, the individual outputs due to each sample, and the composite output 
due to all the samples in the input sequence. Specifically, x[n] can be decomposed as 
the sum of the three sequences *[-2]5[« + 2], jc[0]$[h], and jc[3]5[« — 3] representing 
the three nonzero values in the sequence x[n]. The sequences x[— 2]h[n + 2], jc[0]/i[/i], 
and jc[3]/z[/z — 3] are the system responses to x[— 2]8[n + 2], Jt[0]5[n], and *[3]6[/i — 3], 
respectively. The response to x[n] is then the sum of these three individual responses. 

Although the convolution-sum expression is analogous to the convolution integral 
of continuous-time linear system theory, the convolution sum should not be thought of 
as an approximation to the convolution integral. The convolution integral plays mainly a 
theoretical role in continuous-time linear system theory; we will see that the convolution 
sum, in addition to its theoretical importance, often serves as an explicit realization of a 
discrete-time linear system. Thus, it is important to gain some insight into the properties 
of the convolution sum in actual calculations. 
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9 h[n] 
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x_ 2 [n] = x[-2]8[n + 2] 



-2 



y_ 2 [n]=x[-2]h[n + 2] 



x [n]=:x[0]S[n] 



-• — • — • — •- 



y [n]=x[0]h[n] 



x 3 [n]=x[3]8[n-3] 

3 



y,[n]=x[3]h[n-3] 
3 







l" 



-• — » • 



x[n] = x_ 2 [n] + x [n] + x 3 [n] 



-2 



• • 



-• — •- 



y[»] = y-il n ] + yoH + ^N 



T~» 



Figure 2.8 Representation of the output of a linear time-invariant system as the 
superposition of responses to individual samples of the input. 
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The preceding interpretation of Eq. (2.52) emphasizes that the convolution sum 
is a direct result of linearity and time invariance. However, a slightly different way of 
looking at Eq. (2.52) leads to a particularly useful computational interpretation. When 
viewed as a formula for computing a single value of the output sequence, Eq. (2.52) 
dictates that y[n] (i.e., the nth value of the output) is obtained by multiplying the input 
sequence (expressed as a function of k) by the sequence whose values are h[n — A:], 
— oo < k < oo, and then, for any fixed value of n, summing all the values of the products 
jc[A:]^[w — k], with k a counting index in the summation process. Therefore, the operation 
of convolving two sequences involves doing the computation for all values of n, thus 
generating the complete output sequence y[«], — oo < n < oo. The key to carrying out 
the computations of Eq. (2.52) to obtain y[n] is understanding how to form the sequence 
h[n — k], — oo < k < oo, for all values of n that are of interest. To this end, it is useful to 
note that 

h[n-k]=h[-(k-n)l (2.54) 

The interpretation of Eq. (2.54) is best done with an example. 

Example 2.12 Computation of the Convolution Sum 

Suppose h[k] is the sequence shown in Figure 2.9(a) and we wish to find h[n — k] = 
h[— (k — «)]. Define h\[k\ to be h[— k], which is shown in Figure 2.9(b). Next, define 



h[k] 



-• • • •- 



-3 



(a) 



h[-k] = h[Q-k] 



(b) 



h[n-k] = h[-(k-n)] 



n-6 



n + 3 k 



(c) 



Figure 2.9 Forming the sequence h[n - k]. (a) The sequence h[k] as a function 
of k. (b) The sequence h[-k] as a function of k. (c) The sequence h[n - k] = 
h[-{k - n)] as a function of k for n = 4. 
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hi[k] to be h\ [k], delayed, by n samples on the k axis, i.e., hi [k] = hi [k—n] . Figure 2.9(c) 
shows the sequence that results from delaying the sequence in Figure 2.9(b) by n 
samples. Using the relationship between h\[k] and h[k], we can show that hi[k\ = 
h\[k — ri\ = h[—(k — n)] = h[n — k], and thus, the bottom figure is the desired signal. 
To summarize, to compute h[n — k] from h[k], we first reverse h[k] in time about k = 
and then delay the time-reversed signal by n samples. 

From Example 2.3, it should be clear that, in general, the sequence h[n — k], 
— oo < k < oo, is obtained by 

1. reflecting h[k] about the origin to obtain h[— k]; 

2. shifting the origin of the reflected sequence to k = n. 

To implement discrete-time convolution, the two sequences x[k] and h[n — k] are mul- 
tiplied together for — oo < k < oo, and the products are summed to compute the 
output sample y[ri\. To obtain another output sample, the origin of the sequence h[—k] 
is shifted to the new sample position, and the process is repeated. This computational 
procedure applies whether the computations are carried out numerically on sampled 
data or analytically with sequences for which the sample values have simple formulas. 
The following example illustrates discrete-time convolution for the latter case. 

Example 2.1 3 Analytical Evaluation of the Convolution Sum 

Consider a system with impulse response 

h[n] = u[n] — u[n — N] 



-{ 



1, 0<«<iV-l, 
0, otherwise. 



The input is 

x[n] = a n u[ri\. 

To find the output at a particular index n, we must form the sums over all k of the 
product jc[/:]/i[n - k]. In this case, we can find formulas for y[n] for different sets of 
values of n. For example, Figure 2.10(a) shows the sequences x[k] and h[n — k], plotted 
for n a negative integer. Clearly, all negative values of n give a similar picture; i.e., the 
nonzero portions of the sequences x[k] and h[n — k] do not overlap, so 

y[n] = 0, n < 0. 

Figure 2.10(b) illustrates the two sequences when < n and n — N+\ < 0. These two 
conditions can be combined into the single condition < n < TV — 1. By considering 
Figure 2.10(b), we see that, since 

x[k]h[n -k]= a k , 

it follows that 

n 

y[n] = ^a k , ior0<n<N-l. (2.55) 

k=0 
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Figure 2.10 Sequence involved in computing a discrete convolution, (a)-(c) The 
sequences x[k] and h[n - k] as a function of A" for different values of n. (Only 
nonzero samples are shown.) (d) Corresponding output sequence as a function 
of n. 



The limits on the sum are determined directly from Figure 2.10(b). Equation (2.55) 
shows that y[n] is the sum of n + 1 terms of a geometric series in which the ratio of 
terms is a. This sum can be expressed in closed form using the general formula 



N 2 

I 

k=Ni 



a ^l _ a *2+l 



*-^ 1 —Of 



(2.56) 
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Applying this formula to Eq. (2.55), we obtain 

1 - a n+1 

y [ n ] = f o < n < N - 1. (2.57) 

1 — a 

Finally, Figure 2.10(c) shows the two sequences when < n — N+lor N — 1 < n. As 
before, 

*[fc]/i|/i - k] = a k , n-N+l<k<n, 

but now the lower limit on the sum is n - N + 1, as seen in Figure 2.10(c). Thus, 

n 

y[n] = ^ a k > for AT - 1 < n. (2.58) 

k=n-N+l 

Using Eq. (2.56), we obtain 



y[n] = 



a n-N+l _ a n+l 



1-fl 

or 

y[n] = a»~™ (±^Pj . (2.59) 

Thus, because of the piecewise-exponential nature of both the input and the unit 
sample response, we have been able to obtain the following closed-form expression 
for y[n] as a function of the index n\ 

( 0, n < 0, 

1 - a n+l 



y[n] = t 



y^-, 0<n<N-l, (260) 

a n-N+l (iz^\ , JV-l<n. 



This sequence is shown in Figure 2.10(d). 

Example 2.13 illustrates how the convolution sum can be computed analytically 
when the input and the impulse response are given by simple formulas. In such cases, 
the sums may have a compact form that may be derived using the formula for the sum of 
a geometric series or other "closed-form" formulas. 2 When no simple form is available, 
the convolution sum can still be evaluated numerically using the technique illustrated 
in Example 2.13 whenever the sums are finite, which will be the case if either the input 
sequence or the impulse response is of finite length, i.e., has a finite number of nonzero 
samples. 

2.4 PROPERTIES OF LINEAR TIME-INVARIANT SYSTEMS 

Since all linear time-invariant systems are described by the convolution sum of 
Eq. (2.52), the properties of this class of systems are defined by the properties of discrete- 
time convolution. Therefore, the impulse response is a complete characterization of the 
properties of a specific linear time-invariant system. 

2 Such results are discussed, for example, in Grossman (1992). 
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Some general properties of the class of linear time-invariant systems can be found 
by considering properties of the convolution operation. For example, the convolution 
operation is commutative: 

x[n] * h[n] = h[n] * x[n\ (2.61) 

This can be shown by applying a substitution of variables to Eq. (2.52). Specifically, with 
m = n — k, 

— oo oo 

y[n] = Y^ x[n — m]h[m] = >J /i[m]jc[n — m] = h[n] * x[n], (2.62) 

m=oo m=— oo 

so the roles of x[n] and h[n] in the summation are interchanged. That is, the order of 
the sequences in a convolution is unimportant, and hence, the system output is the 
same if the roles of the input and impulse response are reversed. Accordingly, a linear 
time-invariant system with input x[n] and impulse response h[n] will have the same 
output as a linear time-invariant system with input h[n] and impulse response x[n]. The 
convolution operation also distributes over addition; i.e., 

x[n] * (hi[n] + hi[n\) = x[n] * h\[ri\ + x[n] * /12M. 

This follows in a straightforward way from Eq. (2.52) and is a direct result of the linearity 
and commutativity of convolution. 

In a cascade connection of systems, the output of the first system is the input to 
the second, the output of the second is the input to the third, etc. The output of the last 
system is the overall output. Two linear time-invariant systems in cascade correspond 
to a linear time-invariant system with an impulse response that is the convolution of 
the impulse responses of the two systems. This is illustrated in Figure 2.11. In the upper 
block diagram, the output of the first system will be h\ [n] if x[n] = <5 [«]. Thus, the output 
of the second system (and, by definition, the impulse response of the overall system) 
will be 



h[n] = h\[ri\ *hi[n]. 



(2.63) 



As a consequence of the commutative property of convolution, the impulse response 
of a cascade combination of linear time-invariant systems is independent of the order 
in which they are cascaded. This result is summarized in Figure 2.11, where the three 
systems all have the same impulse response. 



x[n] 



AiM 



*- h i[n\ 




x[n] 



h 2 [n] 



*lM 



y[n] 



x[n] 



Hn]*h 2 [n] 




Figure 2.11 Three linear time-invariant 
systems with identical impulse 
responses. 
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Figure 2.12 (a) Parallel combination 
of linear time-invariant systems, (b) An 
equivalent system. 






(b) 





In a parallel connection, the systems have the same input, and their outputs are 
summed to produce an overall output. It follows from the distributive property of convo- 
lution that the connection of two linear time-invariant systems in parallel is equivalent to 
a single system whose impulse response is the sum of the individual impulse responses; 
i.e., 

h[n]=h 1 [n]+h 2 [n]. (2.64) 

This is depicted in Figure 2.12. 

The constraints of linearity and time invariance define a class of systems with 
very special properties. Stability and causality represent additional properties, and it is 
often important to know whether a linear time-invariant system is stable and whether 
it is causal. Recall from Section 2.2.5 that a stable system is a system for which every 
bounded input produces a bounded output. Linear time-invariant systems are stable if 
and only if the impulse response is absolutely summable, i.e., if 



S= JT \h[k]\ <oo. 



k=-oo 



This can be shown as follows. From Eq. (2.62), 



JT h[k]x[n - k] 



k=—oo 



< ]£ |*[*]||*[n-*]|. 



(2.65) 



(2.66) 



k=— oo 



(2.67) 



I y[n]\ = 

If x[n] is bounded, so that 

I*MI < B x , 
then substituting B x for \x[n — k]\ can only strengthen the inequality. Hence, 

CO 

|y[«]| < B x ]T \h[k]\. 

k=— oo 

Thus, y[n] is bounded if Eq. (2.65) holds; in other words, Eq. (2.65) is a sufficient 
condition for stability. To show that it is also a necessary condition, we must show that if 
5 = oo, then a bounded input can be found that will cause an unbounded output. Such 
an input is the sequence with values 

i !!*/""! , h[n]^0, 
x[n]={ |A[-«]I (2.68) 

0, h[n] = 0, 
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where h*[n] is the complex conjugate of h[ri\. The sequence x[n] is clearly bounded by 
unity. However, the value of the output at n = is 

y[0] = £ x[-WQ = £ 2 = S. (2.69) 

&=— oo k——oo *■ * 

Therefore, if ^ = oo, it is possible for a bounded input sequence to produce an un- 
bounded output sequence. 

The class of causal systems was defined in Section 2.2.4 as those systems for which 
the output y[«o] depends only on the input samples x[n], for n < n Q . It follows from 
Eq. (2.52) or Eq. (2.62) that this definition implies the condition 

h[n] = 0, n < 0, (2.70) 

for causality of linear time-invariant systems. (See Problem 2.62.) For this reason, it is 
sometimes convenient to refer to a sequence that is zero f or n < as a causal sequence, 
meaning that it could be the impulse response of a causal system. 

To illustrate how the properties of linear time-invariant systems are reflected in 
the impulse response, let us consider again some of the systems defined in Examples 2.3- 
2.10. First note that only the systems of Examples 2.3, 2.4, 2.6, and 2.10 are linear and 
time invariant. Although the impulse response of nonlinear or time- varying systems 
can be found, it is generally of limited interest, since the convolution-sum formula and 
Eqs. (2.65) and (2.70), expressing stability and causality, do not apply to such systems. 

First, let us find the impulse responses of the systems in Examples 2.3, 2.4, 2.6, and 
2.10. We can do this by simply computing the response of each system to S[n], using the 
defining relationship for the system. The resulting impulse responses are as follows: 

Ideal Delay (Example 2.3) 

h[n] = 8[n — rid], n^ a positive fixed integer. (2.71) 

Moving Average (Example 2.4) 

1 m 2 

h[n] = ~ Y S[n-k] 

K=—M\ 

( 1 (2-72) 

. , ~M 1 <n<M 2 , 

= < M 1 + M2 + 1 

^ 0, otherwise. 

Accumulator (Example 2.6) 

n 

h[n]= E .*W 



"{ 



k=— 00 

1, n > 0, 



n n ( 273 ) 

0, n < 0, v 



= u[n]. 
Forward Difference (Example 2.10) 

h[n] = 8[n + 1] - S[n]. (2.74) 
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Backward Difference (Example 2.10) 

h[n] = S[n] - S[n - 1]. (2.75) 

Given the impulse responses of these basic systems [Eqs. (2.71)-(2.75)], we can 
test the stability of each one by computing the sum 

oo 

s= £ IM«]|. 

n—— oo 

For the ideal delay, moving-average, forward difference, and backward difference ex- 
amples, it is clear that 5 < oo, since the impulse response has only a finite number of 
nonzero samples. Such systems are called finite-duration impulse response (FIR) sys- 
tems. Clearly, FIR systems will always be stable, as long as each of the impulse response 
values is finite in magnitude. The accumulator, however, is unstable because 

oo 

s = y^w[«] = oo. 

n=0 

In Section 2.2.5, we also demonstrated the instability of the accumulator by giving an 
example of a bounded input (the unit step) for which the output is unbounded. 

The impulse response of the accumulator is infinite in duration. This is an example 
of the class of systems referred to as infinite-duration impulse response (IIR) systems. 
An example of an IIR system that is stable is a system whose impulse response is 
h[n] = a n u[n] with \a\ < 1. In this case, 

oo 

S = X>I". (2.76) 

«=o 

If \a\ < 1, the formula for the sum of the terms of an infinite geometric series gives 

5= r -l R < o. (2.77) 

If, on the other hand, \a\ > 1, the sum is infinite and the system is unstable. 

To test causality of the linear time-invariant systems in Examples 2.3, 2.4, 2.6, and 
2.10, we can check to see whether h[n] = for n < 0. As discussed in Section 2.2.4, the 
ideal delay [nd > in Eq. (2.23)] is causal If nj < 0, the system is noncausal. For the 
moving average, causality requires that —Mi > and M2 > 0. The accumulator and 
backward difference systems are causal, and the forward difference system is noncausal. 

The concept of convolution as an operation between two sequences leads to the 
simplification of many problems involving systems. A particularly useful result can be 
stated for the ideal delay system. Since the output of the delay system is y[n] — x[n — nd], 
and since the delay system has impulse response h[n] = S[n — nd], it follows that 

x[n] * S[n — nd] = S[n — nd] * x[n] = x[n — nd]. (2.78) 

That is, the convolution of a shifted impulse sequence with any signal x[n] is easily 
evaluated by simply shifting x[n] by the displacement of the impulse. 

Since delay is a fundamental operation in the implementation of linear systems, 
the preceding result is often useful in the analysis and simplification of interconnections 
of linear time -invariant systems. As an example, consider the system of Figure 2.13(a), 
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delay 
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(b) 








*- 

x[n] 


Backward 
difference 


y[n] 


Figure 2.13 Equivalent systems found 
by using the commutative property of 
convolution. 






(c) 







which consists of a forward difference system cascaded with an ideal delay of one sample. 
According to the commutative property of convolution, the order in which systems are 
cascaded does not matter, as long as they are linear and time invariant. Therefore, we 
obtain the same result when we compute the forward difference of a sequence and 
delay the result (Figure 2.13a) as when we delay the sequence first and then compute 
the forward difference (Figure 2.13b). Also, it follows from Eq. (2.63) that the overall 
impulse response of each cascade system is the convolution of the individual impulse 
responses. Consequently, 

h[n] = (8[n + 1] - 8[n]) * 8[n - 1] 



= 8[n - 1] * (8[n + 1] - 8[n]) 



(2.79) 



= 8[n] - 8[n - 1]. 

Thus, h[n] is identical to the impulse response of the backward difference system; that 
is, the cascaded systems of Figures 2.13(a) and 2.13(b) can be replaced by a backward 
difference system, as shown in Figure 2.13(c). 

Note that the noncausal forward difference systems in Figures 2.13(a) and (b) 
have been converted to causal systems by cascading them with a delay. In general, any 
noncausal FIR system can be made causal by cascading it with a sufficiently long delay. 

Another example of cascaded systems introduces the concept of an inverse system. 
Consider the cascade of systems in Figure 2.14. The impulse response of the cascade 
system is 

h[n] = u[n] * (8[n] — 8[n — 1]) 



= u[n] — u[n — 1] 



(2.80) 



= 8[n]. 

That is, the cascade combination of an accumulator followed by a backward difference 
(or vice versa) yields a system whose overall impulse response is the impulse. Thus, the 
output of the cascade combination will always be equal to the input, since x[n] * 8[n] = 
x[ri\. In this case, the backward difference system compensates exactly for (or inverts) 
the effect of the accumulator; that is, the backward difference system is the inverse 
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x[n) 



Accumulator 
system 



y[n] 



Backward- 
difference 
system 



x[n] 



Figure 2.14 An accumulator in 
cascade with a backward difference. 
Since the backward difference is the 
inverse system for the accumulator, the 
cascade combination is equivalent to 
the identity system. 



system for the accumulator. From the commutative property of convolution, the accu- 
mulator is likewise the inverse system for the backward difference system. Note that 
this example provides a system interpretation of Eqs. (2.8) and (2.10). In general, if 
a linear time-invariant system has impulse response h[n], then its inverse system, if it 
exists, has impulse response hi [n] defined by the relation 



h[n] * hi[n] = hi[ri\ * h[n] = 8[n]. 



(2.81) 



Inverse systems are useful in many situations in which it is necessary to compensate 
for the effects of a linear system. In general, it is difficult to solve Eq. (2.81) directly 
for hi[n], given h[ri\. However, in Chapter 3 we will see that the z-transform provides a 
straightforward method of finding an inverse system. 

2.5 LINEAR CONSTANT-COEFFICIENT DIFFERENCE EQUATIONS 



An important subclass of linear time-invariant systems consists of those systems for 
which the input x[n] and the output y[n] satisfy an Mh-order linear constant-coefficient 
difference equation of the form 

N M 

Y^ a k y[n - k] = ]T b m x[n - m\ (2.82) 

fc=0 m=0 

The properties discussed in Section 2.4 and some of the analysis techniques introduced 
there can be used to find difference equation representations for some of the linear 
time-invariant systems that we have defined. 

Example 2.14 Difference Equation Representation of 
the Accumulator 

An example of the class of linear constant-coefficient difference equations is the ac- 
cumulator system defined by 



y[n] = ]T x[k]. 



(2.83) 



k=-oo 



To show that the input and output satisfy a difference equation of the form of Eq. (2.82), 
note that we can write the output for n — 1 as 

n-l 

y[n -!]=]£ *M. (2-84) 

k=-oo 

By separating the term x[n] from the sum, we can rewrite Eq. (2.83) as 

y[n]=x[n]+ Y, X W- < 2 ' 85 ) 

k=— oo 
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Substituting Eq. (2.84) into Eq. (2.85) yields 

y[n] = x[n] + y[n - 1], 



fc' 



(2.86) 



from which the desired form of the difference equation can be obtained by grouping 
all the input and output terms on separate sides of the equation: 



y[n] - y[n - 1] = x[n]. 



(2.87) 



Thus, we have shown that, in addition to satisfying the denning relationship of 
Eq. (2.83), the input and output satisfy a linear constant-coefficient difference equation 
of the form Eq. (2.82), with N = 1, a = 1, fli = -1, M = 0, and bo = 1. 

The difference equation in the form of Eq. (2.86) gives us a better understanding 
of how we could implement the accumulator system. According to Eq. (2.86), for each 
value of h, we add the current input value x[n] to the previously accumulated sum 
y[n — 1]. This interpretation of the accumulator is represented in block diagram form 
in Figure 2.15. 



x[n] V 



y[n] 



One-sample 
delay 



y[n-l] 



Figure 2.15 Block diagram of a recursive difference equation representing an 
accumulator. 

Equation (2.86) and the block diagram in Figure 2.15 are referred to as a recursive 
representation of the system, since each value is computed using previously computed 
values. This general notion will be explored in more detail later in the section. 



Example 2.1 5 Difference Equation Representation of 
the Moving-Average System 

Consider the moving-average system of Example 2.4, with M\ = so that the system 
is causal. In this case, from Eq. (2.72), the impulse response is 

M w l = 7T7 tt("W - "[" -M 2 - 1]), (2.88) 



(M 2 + 1) 



from which it follows that 



1 m 2 



(2.89) 



which is a special case of Eq. (2.82), with N = 0, a$ = 1, M = Mi, and bk = 1/(^2 + 1) 
for < k < M 2 . 

Also, the impulse response can be expressed as 

*M = (*r\u <*M - *[« -M 2 - 1]) * u[nl (2.90) 

which suggests that the causal moving-average system can be represented as the cas- 
cade system of Figure 2.16. We can obtain a difference equation for this block diagram 
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delay 





Xl [n] 



Accumulator 
system 



y[n] 



Figure 2.16 Block diagram of the recursive form of a moving-average system, 
by noting first that 



X![n] = 



1 



■(x[n]-x[n-M 2 -l]). 



(2.91) 



(M 2 + 1) 

From Eq. (2.87) of Example 2.14, the output of the accumulator satisfies the difference 
equation 

y[n] - y[n - 1] = xi[n], 

so that 



y[n] - y[n - 1] = 



■(x[n]-x[n-M 2 -l]X 



(2.92) 



(M 2 + 1) 

Again, we have a difference equation in the form of Eq. (2.82), but this time N = 1, 
ao = 1, a\ = -1, M = M.2 and bo = — &m 2 +i = 1/(^2 + 1), and bk = otherwise. 

In Example 2.15, we showed two different difference equation representations 
of the moving-average system. In Chapter 6 we will see that an unlimited number of 
distinct difference equations can be used to represent a given linear time-invariant 
input-output relation. 

Just as in the case of linear constant-coefficient differential equations for contin- 
uous-time systems, without additional constraints or information a linear constant- 
coefficient difference equation for discrete-time systems does not provide a unique 
specification of the output for a given input. Specifically, suppose that, for a given input 
x p [n], we have determined by some means one output sequence y p [n], so that an equa- 
tion of the form of Eq. (2.82) is satisfied. Then the same equation with the same input 
is satisfied by any output of the form 



y[n] = y p [n] + y h [n], 
where yh[n] is any solution to Eq. (2.82) with x[n] = 0, i.e., to the equation 

N 



(2.93) 



^2a k y h [n-k] = 0. 



(2.94) 



k=0 



Equation (2.94) is referred to as the homogeneous equation and yh[n] the homogeneous 
solution. The sequence yh [n] is in fact a member of a family of solutions of the form 



N 



yh[n] = J2 AmZ ™ 



(2.95) 



m=l 
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Substituting Eq. (2.95) into Eq. (2.94) shows that the complex numbers z m must be roots 
of the polynomial 

N 

5>*z-* = 0. (2.96) 

*=o 

Equation (2.95) assumes that all TV roots of the polynomial in Eq. (2.96) are distinct. The 
form of terms associated with multiple roots is slightly different, but there are always 
N undetermined coefficients. An example of the homogeneous solution with multiple 
roots is considered in Problem 2.38. 

Since yh[n] has N undetermined coefficients, a set of N auxiliary conditions is 
required for the unique specification of y[n] for a given x[n\ These auxiliary conditions 
might consist of specifying fixed values of y[n] at specific values of n, such as y[— 1], 
y[— 2], . . . , y[— N], and then solving a set of TV linear equations for the Af undetermined 
coefficients. 

Alternatively, if the auxiliary conditions are a set of auxiliary values of y[n], the 
other values of y[n] can be generated by rewriting Eq. (2.82) as a recurrence formula, 
i.e., in the form 

n m h 

yW = - E -y\» - Q + E - x \» - k ^ < 2 - 97 ) 

If the input x[n], together with a set of auxiliary values, say, j>[— 1], y[~ 2]» • • • . y[— N]> is 
specified, then y[0] can be determined from Eq. (2.97). With y[0], y[-l], . . . , y[- N+ 1] 
available, y[l] can then be calculated, and so on. When this procedure is used, y[n] is 
said to be computed recursively; i.e., the output computation involves not only the input 
sequence, but also previous values of the output sequence. 

To generate values of y[n] for n < —N (again assuming that the values y[— 1], 
y[— 2], . . . , y[— N] are given as auxiliary conditions), we can rearrange Eq. (2.82) in the 
form 

y [ n - N ] = - V ^y[n - k] + V -^x[n - % (2.98) 

U a " U aN 

from which y[—N — 1], y[— N — 2], ... can be computed recursively. The following 
example illustrates this recursive procedure. 

Example 2.16 Recursive Computation of Difference 
Equations 

The difference equation satisfied by the input and output of a system is 

y[n] = ay[n-l] + x[n]. (2.99) 

Consider the input x[n] = KS[n], where K is an arbitrary number, and the auxiliary 
condition y[— 1] = c. Beginning with this value, the output for n > —1 can be computed 
recursively as follows: 

y[0] =ac + K, 

y[l] = ay[0] + = a(ac + K) = a 2 c + aK, 
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y[2] = ay[l] + = a(a 2 c + aK) = a 3 c + a 2 K, 
y[3] = ay[2] + = a(a 3 c + a 2 K ) = a 4 c + a 3 /C, 

For this simple case, we can see that for n > 0, 

y[n] = a n+1 c + a"^, for n > 0. (2.100) 

To determine the output for n < 0, we express the difference equation in the form 

y[n - 1] = « _1 (y["] - *[«]), (2.101a) 

or 

y[n] = 0- ] (y[rt -f 1] - jc[/i + 1]). (2.101b) 

Using the auxiliary condition y[—l] = c, we can compute y[n] for « < — 1 as follows: 

y[-2] = a-\y[-l]-x[-l]) = a- l c, 

y[-3] = a~ l {y[-2] - x[-2]) = a"^-^ = ^ _2 c, 

y[-4] = a _1 W-3] - jc[-3]) = a-^^c = fl- 3 c, 

It then follows that 

y[n] = a n+1 c for n < -1. (2.102) 

In sum, combining Eqs. (2.100) and (2.102), we obtain, as the result of the recursive 
computation, 

y[n] = a n+l c + Ka n u[n], for all n. (2.103) 

Several important points are illustrated by the solution of Example 2.16. First, 
note that we implemented the system by recursively computing the output in both the 
positive and the negative direction, beginning with n = — 1. Clearly, this procedure is 
noncausal. Also, note that when K = 0, the input is zero, but y[n] = a n+1 c. A linear 
system requires that the output be zero for all time when the input is zero for all time. 
(See Problem 2.21.) Consequently, this system is not linear. Furthermore, if the input 
were shifted by no samples, i.e., xi[n] = KS[n — no], the output would be 

yi [n] = a n+1 c + Ka n ~ no u[n - « ], (2.104) 

and the system is therefore not time invariant. 

Our principal interest in this text is in systems that are linear and time invariant, 
in which case the auxiliary conditions must be consistent with these additional require- 
ments. In Chapter 3, when we discuss the solution of difference equations using the 
z-transform, we implicitly incorporate conditions of linearity and time invariance. As 
we will see in that discussion, even with the additional constraints of linearity and time 
invariance, the solution to the difference equation, and therefore the system, is not 
uniquely specified. In particular, there are, in general, both causal and noncausal linear 
time-invariant systems consistent with a given difference equation. 

If a system is characterized by a linear constant-coefficient difference equation 
and is further specified to be linear, time invariant, and causal, the solution is unique. 
In this case, the auxiliary conditions are often stated as initial-rest conditions. In other 
words, the auxiliary information is that if the input x[n] is zero for n less than some time 



Sec. 2.5 Linear Constant-Coefficient Difference Equations 39 

no, then the output y[n] is constrained to be zero for n less than no. This then provides 
sufficient initial conditions to obtain y[n] for n > no recursively using Eq. (2.97). 

To summarize, for a system for which the input and output satisfy a linear constant- 
coefficient difference equation: 

• The output for a given input is not uniquely specified. Auxiliary information or 
conditions are required. 

• If the auxiliary information is in the form of N sequential values of the output, 
later values can be obtained by rearranging the difference equation as a recursive 
relation running forward in n, and prior values can be obtained by rearranging 
the difference equation as a recursive relation running backward in n. 

• Linearity, time in variance, and causality of the system will depend on the auxiliary 
conditions. If an additional condition is that the system is initially at rest, then the 
system will be linear, time invariant, and causal. 

With the preceding discussion in mind, let us now consider again Example 2.16, 
but with initial-rest conditions. With x[n] = i£5[n], y[— 1] = 0, since x[n] = 0, n < 0. 
Consequently, from Eq. (2.103), 

y[n] = Ka n u[n\. (2.105) 

If the input is instead KS[n — no], again with initial-rest conditions, then the recursive 
solution is carried out using the initial condition v[n] = 0, n < no. Note that for no < 0, 
initial rest implies that v[— 1] ^ 0. That is, initial rest does not always mean v[— 1] = 
• ■ • = y[—N] = 0. It does mean that y[no — 1] = • * = y[no — N] = if x[n] = for 
n < no- Note also that the impulse response for the example is h[n] = a"w[n]; i.e., h[n] 
is zero for n < 0, consistent with the causality imposed by the assumption of initial rest. 
The preceding discussion assumed that N > 1 in Eq. (2.82). If, instead, N = 0, 
no recursion is required to use the difference equation to compute the output, and 
therefore, no auxiliary conditions are required. That is, 

M fh \ 

yM = £(^) *[«-*]■ ( 2 - 106 ) 

Equation (2.106) is in the form of a convolution, and by setting x[n] = S[n], we see that 
the impulse response is 

M 



fh \ 



or 




, , < n < M, 
h[n]= {\a Q J ~ ~ (2.107) 

otherwise. 

The impulse response is obviously finite in duration. Indeed, the output of any FIR sys- 
tem can be computed nonrecursively using the difference equation of Eq. (2.106), where 
the coefficients are the values of the impulse response sequence. The moving-average 
system of Example 2.15 with Mi = is an example of a causal FIR system. An interest- 
ing feature of that system was that we also found a recursive equation for the output. In 



40 Discrete-Time Signals and Systems Chap. 2 

Chapter 6 we will show that there are many possible ways of implementing a desired sig- 
nal transformation using difference equations. Advantages of one method over another 
depend on practical considerations such as numerical accuracy, data storage, and the 
number of multiplications and additions required to compute each sample of the output. 



2.6 FREQUENCY-DOMAIN REPRESENTATION OF 
DISCRETE-TIME SIGNALS AND SYSTEMS 

In the previous sections, we have introduced some of the fundamental concepts of the 
theory of discfete-time signals and systems. For linear time-invariant systems, we saw 
that a representation of the input sequence as a weighted sum of delayed impulses 
leads to a representation of the output as a weighted sum of delayed impulse responses. 
As with continuous-time signals, discrete-time signals may be represented in a number 
of different ways. For example, sinusoidal and complex exponential sequences play a 
particularly important role in representing discrete-time signals. This is because com- 
plex exponential sequences are eigenf unctions of linear time-invariant systems and the 
response to a sinusoidal input is sinusoidal with the same frequency as the input and 
with amplitude and phase determined by the system. This fundamental property of 
linear time-invariant systems makes representations of signals in terms of sinusoids or 
complex exponentials (i.e., Fourier representations) very useful in linear system theory. 

2.6.1 Eigenf unctions for Linear Time-Invariant Systems 

To demonstrate the eigenfunction property of complex exponentials for discrete-time 
systems, consider an input sequence x[n] = e^ n for — oo < n < oo, i.e., a complex 
exponential of radian frequency co. From Eq. (2.62), the corresponding output of a 
linear time-invariant system with impulse response h[n] is 

oo 



fc=— 00 



y[n] = J^ h[k]e Mn -Q 

(2.108) 
]e -j<ok 




£ h[k]i 

\k=—oo 

If we define 

H(e ito ) = J2 h l k ] e ~ itok > ( 2 '!09) 

k=— oo 

Eq. (2.108) becomes 

y[n] = H(e^)e^\ (2.110) 

Consequently, e iain is an eigenfunction of the system, and the associated eigenvalue is 
//(e ;w ). From Eq. (2.110), we see that H(e^) describes the change in complex amplitude 
of a complex exponential input signal as a function of the frequency a>. The eigenvalue 
H(e^) is called the frequency response of the system. In general, H(e j<0 ) is complex 
and can be expressed in terms of its real and imaginary parts as 

Hie'") = H R (en + ; #/(<?>) (2.111) 
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or in terms of magnitude and phase as 

H(e jw ) = \H{e ito )\e i<H ^ ia> \ (2.112) 

Example 2.1 7 Frequency Response of the Ideal Delay 
System 

As a simple example of how we can find the frequency response of a linear time- 
invariant system, consider the ideal delay system defined by 

y[n]=x[n-n d ], (2.113) 

where rid is a fixed integer. If we consider x[n] = ei mn as input to this system, then, 
from Eq. (2.113), we have 

y\ri\ = e^ n ~ nd ^ = e -Jo> n d e }«>n 

Thus, for any given value of <o, we obtain an output that is the input multiplied by a 
complex constant, the value of which depends on the frequency <o and the delay rid. 
The frequency response of the ideal delay is therefore 

H(ei m )=e-i cond . (2.114) 

As an alternative method of obtaining the frequency response, recall that h[n] = 
8[n- rid] for the ideal delay system. Using Eq. (2.109), we obtain 

00 

H(e> a >) = ^ ^\n-rid\e-^ n ^e-^ nd . 

n=-oo 

From the Euler relation, the real and imaginary parts of the frequency response are 

H R {eJ°>) = cos((on d ), (2.115a) 

///(<?>*>) = - sm(con d ). (2.115b) 

The magnitude and phase are 

\H(e^)\ = 1, (2.116a) 

<H{ei Q> ) = -<on d . (2.116.b) 

In Section 2.7 we will show that a broad class of signals can be represented as a 
linear combination of complex exponentials in the form 

x[n] = ^2a k e iwkn . (2.117) 

k 

From the principle of superposition, the corresponding output of a linear time-invariant 
system is 

y[n] = Y^ ot k H{e i<0k )e^ kn . (2.118) 

k 

Thus, if we can find a representation of x[n] as a superposition of complex exponential 
sequences, as in Eq. (2.117), then we can find the output using Eq. (2.118) if we know 
the frequency response of the system. The following simple example illustrates this 
fundamental oroDertv of linear time-invariant svstems. 
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Example 2.18 Sinusoidal Response of LTI Systems 

Since it is simple to express a sinusoid as a linear combination of complex exponentials, 
let us consider a sinusoidal input 

x[n] = A cos(<o n + cf>) = ^J V" " + ~e-^e~^ n . (2.119) 

From Eq. (2.110), the response to xi[n] = (A/2)e^e^ Qn is 

yi [n] = H(e i »°)^ei+e iloon . (2.120a) 

The response to x 2 [n] = (A/2)e-1*e-i a ° n is 

y 2 [n] = H(e- ftUo )je-f+e-1" on . (2.120b) 

Thus, the total response is 

y[n] = ^[H(e IcOQ )ei*e j<0 ° n + H(e" J<OQ )e-^e-^ Qn l (2.121) 

If fc[n] is real, it can be shown (see Problem 2.71) that H(e~^°) = H*(e^ Q ). Conse- 
quently, 

y[n] = A\H(e }Q}(i )\ cos(<o n + <j> + 0), (2.122) 

where 9 = <H(e^°) is the phase of the system function at frequency o)q. 

For the simple example of the ideal delay, \H(e^°)\ = 1 and 9 = —coorid, as we 
determined in Example 2.17. Therefore, 

y[n] = A cos(a>o" + <t> - <*>ond) 

(2.123) 
= A cos[a>o(rt - rid) + 0]» 

which is consistent with what we would obtain directly using the definition of the ideal 
delay system. 

The concept of the frequency response of linear time-invariant systems is essen- 
tially the same for continuous-time and diserete-time systems. However, an important 
distinction arises because the frequency response of discrete-time linear time-invariant 
systems is always a periodic function of the frequency variable co with period In. To 
show this, we substitute co + 2jr into Eq. (2.109) to obtain 

00 

H(e^ +27r) ) = Y, %K ;>+2jr)n . (2.124) 

n=— oo 

Using the fact that e ±i2nn = 1 for n an integer, we have 

e -j(o)+27t)n _ e -jo>n e -j2nn _ € -}<on^ 

Therefore, 

H{e^ +2lt) ) = Hie*"), (2.125) 

and, more generally, 

fj( c K«H-2*r)) = H ( e J^) f for r an integer. (2.126) 

That is, H(e^) is periodic with period 2jr. Note that this is obviously true for the ideal 
delay system, since e ~^ 0>+2n ^ nd = e"^ nd when rid is an integer. 
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The reason for this periodicity is related directly to our earlier observation that 
the sequence 

{e j<on }, -oo < w < oo, 
is indistinguishable from the sequence 



[e 



j((o+27i)n 



}, 



— oo < n < oo. 



Because these two sequences have identical values for all «, the system must respond 
identically to both input sequences. This condition requires that Eq. (2.125) hold. 

Since H(e^) is periodic with period 2tt, and since the frequencies co and 
co + In are indistinguishable, it follows that we need only specify H(e^) over an inter- 
val of length 27T, e.g., < co < 2n or —it < co < n. The inherent periodicity defines 
the frequency response everywhere outside the chosen interval. For simplicity and for 
consistency with the continuous-time case, it is generally convenient to specify H(e^) 
over the interval — it < co < it. With respect to this interval, the "low frequencies" are 
frequencies close to zero, while the "high frequencies" are frequencies close to ±it. Re- 
calling that frequencies differing by an integer multiple of lit are indistinguishable, we 
might generalize the preceding statement as follows: The "low frequencies" are those 
that are close to an even multiple of it, while the "high frequencies" are those that are 
close to an odd multiple of it, consistent with our earlier discussion in Section 2.1. 

Example 2.19 Ideal Frequency-Selective Filters 

An important class of linear time-invariant systems includes those systems for which 
the frequency response is unity over a certain range of frequencies and is zero at 
the remaining frequencies. TTiese correspond to ideal frequency -selective filters. The 
frequency response of an ideal lowpass filter is shown in Figure 2.17(a). Because of the 
inherent periodicity of the discrete-time frequency response, it has the appearance of 



-2tt -2tt + o) r -it 



(a) 



IT 2.TT - 0). 2lT 0) 



H lp (en 



(b) 

Figure 2.17 Ideal lowpass filter showing (a) periodicity of the frequency response 
and (b) one period of the periodic frequency response. 
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Figure 2.18 Ideal frequency-selective filters, (a) Highpass filter, (b) Bandstop 
filter, (c) Bandpass filter. In each case, the frequency response is periodic with 
period In. Only one period is shown. 



a multiband filter, since frequencies around co = 2tt are indistinguishable from fre- 
quencies around o> = 0. In effect, however, the frequency response passes only low 
frequencies and rejects high frequencies. Since the frequency response is completely 
specified by its behavior over the interval — n < co < n, the ideal lowpass filter fre- 
quency response is more typically shown only in the interval — n < <o < jt, as in 
Figure 2.17(b). It is understood that the frequency response repeats periodically with 
period 2n outside the plotted interval. The frequency responses for ideal highpass, 
bandstop, and bandpass filters are shown in Figures 2.18(a), (b), and (c), respectively. 



Example 2.20 Frequency Response of the 
Moving-Average System 

The impulse response of the moving-average system of Example 2.4 is 

I tlm ■ ** , 1 * ~Mi<n<M 2 , 
h[n]=l ^1 + ^2 + 1 

0, otherwise. 



Sec. 2.6 Frequency-Domain Representation of Discrete-Time Signals and Systems 



45 



Therefore, the frequency response is 



M 2 



H(e j0} ) = V* e- iam . 

y } M1 + M2 + 1 Z-i M 

n=—M\ 

Equation (2.127) can be expressed in closed form by using Eq. (2.56), so that 

^ e }coMi _ e -ja)(M 2 +l) 



(2.127) 



H(e)°>) = 



Mi + M 2 + 1 1 - e-}°> 

I e Ja>(M l +M 2 +l)/2 _ e -jco(M l +M 2 +l)/2 

Mi + M 2 + 1 1 - e-}°> 

I e Jco(Mi+M 2 +l)/2 _ e -jw(Mi+M 1 +l)/2 



Mi + M 2 + 1 



e ja>/2 _ e -jco/2 



e -;<y(A/ 2 -A*i+l)/2 



€ -jco(M 2 -M 1 )/2 



(2.128) 



1 sinKMt + M 2 + l)/2] c _ ia(Mi _ Mt)n 

Mi + M 2 + 1 sin(o>/2) 
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Figure 2.19 (a) Magnitude and (b) phase of the frequency response of the 
moving-average system for the case M^ = and M2 = 4. 



The magnitude and phase of H(e }( °) are plotted in Figure 2.19 for Mi = and M 2 = 4. 
Note that H(e J0} ) is periodic, as is required of the frequency response of a discrete- 
time system. Note also that \H(e ia> )\ falls off at "high frequencies" and <H(e^ co ), i.e., 
the phase of H{e^), varies linearly with a>. ITiis attenuation of the high frequencies 
suggests that the system will smooth out rapid variations in the input sequence; in other 
words, the system is a rough approximation to a lowpass filter. This is consistent with 
what we would intuitively expect about the behavior of the moving-average system. 



46 Discrete-Time Signals and Systems Chap. 2 

2.6.2 Suddenly Applied Complex Exponential Inputs 

We have seen that complex exponential inputs of the form e )0in for — oo < n < oo 
produce outputs of the form H(e jw )e^ wn for linear time-invariant systems. Such inputs, 
nonzero over a doubly infinite domain, may seem to be impractical models of signals; 
however, as we will see in the next section, models of this kind are crucial to the mathe- 
matical representation of a wide range of signals, even those that exist only over a finite 
domain. Even so, we can gain additional insight into linear time-invariant systems by 
considering more practical-appearing inputs of the form 

x[n] = e Jwn u[n], 

i.e., complex exponentials that are suddenly applied at an arbitrary time, which for 
convenience here we choose as n = 0. Using the convolution sum in Eq. (2.62), the 
corresponding output of a causal linear time-invariant system with impulse response 
h[n] is 

!0, n < 0, 

(j2h[k]e- ja,k \e }Q}n , n>0. 

If we consider the output for n > 0, we can write 

y[n] = ( J2 h [ k ] e ' j<0k ) eJa>n ~ ( J2 Wle~ i0 *) e Jan (2.129) 

= H(ei°>)e jwn - ( f^ M*K M ) e jo>n . (2.130) 

From Eq. (2.130), we see that the output consists of the sum of two terms, i.e., y[n] = 
yss[n] + yt[n\- The first term, 

y a [n] = H(e1»)e jan , 

is called the steady-state response. It is identical to the response of the system when the 
input is e i<an for all n. In a sense, the second term, 

CO 

y t [n] = - J2 h[k]e- i0 *e ian , 

k=n+l 

is the amount by which the output differs from the eigenfunction result. This part is 
called the transient response, because it is clear that in some cases it may approach zero. 
To see the conditions for which this is true, let us consider the size of the second term. 
Its magnitude is bounded as follows: 

CO 



\y,[n]\ = 



y] h[k]e '~"e> 



< £ I*WI- (2131) 

k=n+l 



From Eq. (2.131), it should be clear that if the impulse response has finite length, so that 
h[n] = except f or < n < M, then the term y t [n] = for n + 1 > M, or n > M — 1. 
In this case, 

y[n] = y s *[n\ = H(e ja> )e jwn , for n > M - 1. 
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When the impulse response has infinite duration, the transient response does not disap- 
pear abruptly, but if the samples of the impulse response approach zero with increasing 
n, then y t [n] will approach zero. Note that Eq. (2.131) can be written 



\yt[n]\ = 



J2 h w 



-}(ok }(on 



k=n+l 



± E im*]i<X>mi 



(2.132) 



k=n+l 



k=0 



That is, the transient response is bounded by the sum of the absolute values of all of the 
impulse response samples. If the right-hand side of Eq. (2.132) is bounded, so that 

CO 

k=0 

then the system is stable. From Eq. (2.132), it follows that, for stable systems, the tran- 
sient response must become increasingly smaller as n -^ oo. Thus, a sufficient condition 
for the transient response to die out is that the system be stable. 

Figure 2.20 shows the real part of a complex exponential signal with frequency 
to = 27T/10. The solid dots indicate the samples x[k] of the suddenly applied complex 
exponential, while the open circles indicate the samples of the complex exponential that 
are "missing." The shaded dots indicate the samples of the impulse response h[n — k] 
as a function of k for n — 8. In the finite-length case shown in Figure 2.20(a), it is clear 
that the output would consist only of the steady -state component for n > 8, while in 
the infinite-length case, it is clear that the missing samples have less and less effect as n 
increases, due to the decaying nature of the impulse response. 
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Figure 2.20 Illustration of real part of suddenly applied complex exponential input 
with (a) finite-length impulse response and (b) infinite-length impulse response. 
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The condition for stability is also a sufficient condition for the existence of the 
frequency response function. To see this, note that, in general, 



£ h[k] 



e >" k 



k=—oo 



< ]T \h[k]e-i" k \ < ]T \h[k]\, 



k=—oo k=—oo 



< OO 



\H(en\ = 
so the general condition 

CO 

ensures that H(ei w ) exists. It is no surprise that the condition for existence of the 
frequency response is the same as the condition for dominance of the steady-state 
solution. Indeed, a complex exponential that exists for all n can be thought of as one 
that is applied at n = — oo. The eigenfunction property of complex exponentials depends 
on stability of the system, since at finite w, the transient response must have become 
zero, so that we only see the steady-state response H{e^)e^ n for all finite n. 

2.7 REPRESENTATION OF SEQUENCES BY FOURIER TRANSFORMS 

One of the advantages of the frequency-response representation of a linear time- 
invariant system is that interpretations of system behavior such as the one we made 
in Example 2.20 often follow easily. We will elaborate on this point in considerably 
more detail in Chapter 5. At this point, however, let us return to the question of how 
we may find representations of the form of Eq. (2.117) for an arbitrary input sequence. 
Many sequences can be represented by a Fourier integral of the form 

x[n] = -?- [* X(e jw )e j(tin da>, (2.133) 

Lit J_ n 

where 

CO 

X(e jw ) = Y^ x[n]e- ian . (2.134) 

n=— oo 

Equations (2.133) and (2.134) together form a Fourier representation for the sequence. 
Equation (2,133), the inverse Fourier transform, is a synthesis formula. That is, it repre- 
sents x[n] as a superposition of infinitesimally small complex sinusoids of the form 

^X(ene jwn d<o, 

with co ranging over an interval of length lit and with X(e ia) ) determining the relative 
amount of each complex sinusoidal component. Although, in writing Eq. (2.133), we 
have chosen the range of values for co between — 7r and +7r, any interval of length 2n 
can be used. Equation (2.134), the Fourier transform, 3 is an expression for computing 
X{e jto ) from the sequence x[ri\, i.e., for analyzing the sequence x[n] to determine how 
much of each frequency component is required to synthesize x[n] using Eq. (2.133). 

3 Sometimes we will refer to Eq. (2.134) more explicitly as the discrete-time Fourier transform, or 
DTFT, particularly when it is important to distinguish it from the continuous-time Fourier transform. 
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In general, the Fourier transform is a complex- valued function of co. As with the 
frequency response, we may either express X(e* w ) in rectangular form as 

X(e><°) = X R {e>») + jXfa'' ) (2.135a) 

or in polar form as 

X(e ia ) = \X(e ia )\e i<x ^ m K (2.135b) 

The quantities \X(e* w )\ and <X(ei ( °) are the magnitude and phase, respectively, of the 
Fourier transform. The Fourier transform is sometimes referred to as the Fourier spec- 
trum or, simply, the spectrum. Also, the terminology magnitude spectrum or amplitude 
spectrum is sometimes used to refer to \X(e ie> )\ 9 and the angle or phase <X(e ico ) is 
sometimes called the phase spectrum. 

The phase <X(e }w ) is not uniquely specified by Eq. (2.135b), since any integer 
multiple of lit may be added to <X{e jw ) at any value of co without affecting the result of 
the complex exponentiation. When we specifically want to refer to the principal value, 
i.e., <X(ei w ) restricted to the range of values between — it and +7r, we will denote this 
as AKG[X(e i<0 )]. If we want to refer to a phase function that is a continuous function 
of co for < co < 7r, we will use the notation Bxg[X(e ia> )]. 

By comparing Eqs. (2.109) and (2.134), we can see that the frequency response of 
a linear time-invariant system is simply the Fourier transform of the impulse response 
and that, therefore, the impulse response can be obtained from the frequency response 
by applying the inverse Fourier transform integral; i.e., 

h[n] = -!- P H{e iw )e jwn dco. (2.136) 

2?r J_ n 



As discussed previously, the frequency response is a periodic function. Likewise, 
the Fourier transform is periodic with period 2n. Indeed, Eq. (2.134) is of the form of 
a Fourier series for the continuous-variable periodic function X(e ito ), and Eq. (2.133), 
which expresses the sequence values x[n] in terms of the periodic function X(e }w ), is 
of the form of the integral that would be used to obtain the coefficients in the Fourier 
series. Our use of Eqs. (2.133) and (2.134) focuses on the representation of the sequence 
x[n]. Nevertheless, it is useful to be aware of the equivalence between the Fourier series 
representation of continuous-variable periodic functions and the Fourier transform 
representation of discrete-time signals, since all the familiar properties of Fourier series 
can be applied, with appropriate interpretation of variables, to the Fourier transform 
representation of a sequence. 

We have not yet shown explicitly that Eqs. (2.133) and (2.134) are inverses of 
each other, nor have we considered the question of how broad a class of signals can be 
represented in the form of Eq. (2.133). To demonstrate that Eq. (2.133) is the inverse 
of Eq. (2.134), we can find X(e* w ) using Eq. (2.134) and then substitute the result into 
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Eq. (2.133). Specifically, consider 

T~ I" [ Jl x[m]e- j<om )e } ' <on dco = x[n], (2.137) 

J ~ n \m=— oo / 

where we have tentatively used x[n] to denote the result of the Fourier synthesis. We 
wish to show that x[n] = x[n] if X(e^) can be found using Eq. (2.134). Note that 
the "dummy index" of summation has been changed to m to distinguish it from n, the 
variable index in Eq. (2.133). If the infinite sum converges uniformly for all co, then we 
can interchange the order of integration and summation to obtain 

*[n] = J2 *M (7- ^ € Mn - m) dco\ . (2.138) 

m=— 00 ^ J —it / 

Evaluating the integral within the parentheses gives 

_i r e Mn- m)dw = sjn^n-m) 
In J_ n 7t(n — m) 

1, m = n, 
0, m^n, 

= 8[n — m]. 

Thus, 

00 
x[n] = 2_, x[m]S[n — m] = x[n], 

m=—oo 

which is what we set out to show. 

Determining the class of signals that can be represented by Eq. (2.133) is equiv- 
alent to considering the convergence of the infinite sum in Eq. (2.134). That is, we 
are concerned with the conditions that must be satisfied by the terms in the sum in 
Eq. (2.134) such that 

\X{e j(a )\ < 00 for all w, 

where X(e^° } ) is the limit asM-y 00 of the finite sum 

M 

X M (e ja} ) = Y^ *M*~ ;Vwi - ( 2 - 13 9) 

n=-M 

A sufficient condition for convergence can be found as follows: 

00 
\X(e>")\ = 



J2 x[n]e-' m 

l= — OQ 
OO 

< Y, l*Mlk -y " 

n=— 00 

00 

< ^ \x[n]\ < 00 
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Thus, if x[n] is absolutely summable, then X(e i<0 ) exists. Furthermore, in this case, the 
series can be shown to converge uniformly to a continuous function of a>. 

Since a stable sequence is, by definition, absolutely summable, all stable sequences 
have Fourier transforms. It also follows, then, that any stable system will have a finite 
and continuous frequency response. 

Absolute summability is a sufficient condition for the existence of a Fourier trans- 
form representation. In Examples 2.17 and 2.20, we computed the Fourier transforms 
of the sequences 8[n — rid] and [1/(M\ + M2 + l)](w[« + M\\ — u[n — M 2 — 1]). These 
sequences are absolutely summable, since they are finite in length. Clearly, any finite- 
length sequence is absolutely summable and thus will have a Fourier transform repre- 
sentation. In the context of linear time-invariant systems, any FIR system will be stable 
and therefore will have a finite, continuous frequency response. When a sequence has 
infinite length, we must be concerned about convergence of the infinite sum. The fol- 
lowing example illustrates this case. 

Example 2.21 Absolute Summability for a 
Suddenly-Applied Exponential 

Let x[n] = a n u[n]. The Fourier transform of this sequence is 

00 oa 

X{ei°>) = ^2 <* n e~ }0,n = ^2(ae- }ca ) n 



n=0 «=o 

1 



if\ae- JC0 \<l or \a\ < 1. 



1 - ae-}™ 
Clearly, the condition \a\ < 1 is the condition for the absolute summability of x[n]; i.e., 

V] \a\ n = r—r- < 00 if \a\ < 1. (2.140) 

n 1 - kl 

Absolute summability is a sufficient condition for the existence of a Fourier trans- 
form representation, and it also guarantees uniform convergence. Some sequences are 
not absolutely summable, but are square summable, i.e., 

00 
J2 l*[n]| 2 <oo. (2.141) 

Such sequences can be represented by a Fourier transform if we are willing to relax the 
condition of uniform convergence of the infinite sum defining X(e ia ). Specifically, in 
this case we have mean-square convergence; that is, with 



X(e Ji °) = ^2 *[n]e~ j0}n (2.142a) 



and 



it follows that 



n=— 00 
M 



X M (e jC0 ) = Y, *["K /<U "> (2.142b) 



n=-M 



lim / \X(e^)-X M (e ia, )\ 2 dco = 0. (2.143) 

M-+OQ J_ n 
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In other words, theerror \X(e ia) )— XM(e jw )\ may not approach zero at each value of 
co as M -* oo, but the total "energy" in the error does. Example 2.22 illustrates this case. 



Example 2.22 Square-Summability for the Ideal 
Lowpass Filter 

Let us determine the impulse response of the ideal lowpass filter discussed in Example 
2.19. The frequency response is 



M]p{e > ~ 1 0, CO c < M < 71, 



(2.144) 



with periodicity In also understood. The impulse response h\p\n\ can be found using 
the Fourier transform synthesis equation (2.133): 



1 f Wc ■ 

171 J-<o c 



h ]p [n] = 



l dco 



= — !— \e ja)n T c = —*—(£><" - e- JQ)cn ) 
Injn L J -^ Ixjn 



(2.145) 



sin co c n 
Tin 



— oo < n < oo. 



We note that, since /ii p [«] is nonzero for n < 0, the ideal lowpass filter is noncausal. 
Also, hip[n] is not absolutely summable. The sequence values approach zero as n -> oo, 
but only as 1/n. This is because H\ ? {e^) is discontinuous at co = co c . Since h\ ? \n\ is not 
absolutely summable, the infinite sum 



sin <o c n 



Esina>, 
Tin 



•jam 



H M (en,M = l 




H M (e)») i M = 3 




(a) 



H M {ei%M = l 




TT (O -IT 



(b) 



H M (e**) t M = 19 




(c) 



Figure 2.21 Convergence of the Fourier transform. The oscillatory behavior at 
co = co c is often called the Gibbs phenomenon. 
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does not converge uniformly for all values of <w. To obtain an intuitive feeling for this, 
let us consider Hu^ w> ) as the sum of a finite number of terms: 

M 

H M (en = J2 S ~ Le ~ i °'"- ( 2 - 146 ) 

n=-M 

We can show that //m(^ j<u ) can be expressed as 

2tt J_ t 



-<a c 



sin[(a> - 0)]/2 



The function HM{e^ m ) is evaluated in Figure 2.21 for several values of M. Note that 
as M increases, the oscillatory behavior at o> = oo c (often referred to as the Gibbs 
phenomenon) is more rapid, but the size of the ripples does not decrease. In fact, it 
can be shown that as M -» oo, the maximum amplitude of the oscillations does not 
approach zero, but the oscillations converge in location toward the point co = co c . Thus, 
the infinite sum does not converge uniformly to the discontinuous function H\ p (e^ w ) 
of Eq. (2.144). However, /ii p [n], as given in Eq. (2.145), is square summable, and 
correspondingly, HM(e JC0 ) converges in the mean-square sense to i/i p (e ;£W ); i.e., 



M- 



[ 

J —71 



lim / \Hi p (en-H M (e Jw )\ 2 da> = 0, 



Although the error between limM^co #A/(e ;w ) and H\ v (ei w ) might seem unimportant 
because the two functions differ only at oo = co c , we will see in Chapter 7 that the be- 
havior of finite sums has important implications in the design of discrete-time systems 
for filtering. 

It is sometimes useful to have a Fourier transform representation for certain se- 
quences that are neither absolutely summable nor square summable. We illustrate sev- 
eral of these in the following examples. 

Example 2.23 Fourier Transform of a Constant 

Consider the sequence x[n] = 1 for all n. This sequence is neither absolutely summable 
nor square summable, and Eq. (2.134) does not converge in either the uniform or mean- 
square sense for this case. However, it is possible and useful to define the Fourier 
transform of the sequence x[n] to be the periodic impulse train 4 

00 

X(e }0J ) = Y2 IxHv + lxr)- (2.147) 

r=-oo 

The impulses in this case are functions of a continuous variable and therefore are of 
"infinite height, zero width, and unit area," consistent with the fact that Eq. (2.134) 
does not converge. The use of Eq. (2.147) as a Fourier representation of the se- 
quence x[n] = 1 is justified principally because formal substitution of Eq. (2.147) 
into Eq. (2.133) leads to the correct result. Example 2.24 represents a generalization 
of this example. 

4 The impulse function is defined as that "function" that has the following properties: S (a>) = forty ^ 0; 
X(e^)S((o) = X(e^)S(co); f™ x 8(<o)d<o = 1; and 8(co) * X(e^) = X(e^), where * denotes continuous- 
variable convolution. See Oppenheim and Willsky (1997) for a discussion of the impulse function. 
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Example 2.24 Fourier Transform of Complex 
Exponential Sequences 

Consider a sequence x[n] whose Fourier transform is the periodic impulse train 

00 

X(e' a ) = ^2 2tt8((o -coq+ 2nr). (2.148) 

r=-oo 

We show in this example that x[n] is the complex exponential sequence e^ ". 

We can safely assume that — n < cdo < n in this problem. If the chosen value 
of o)o does not satisfy this requirement, there is a choice of wq in the interval which 
produces the same X(e^ co ) 1l since the impulses repeat periodically every 2n. Thus, we 
can redefine cdo to be the frequency of the impulse in the summation of Eq. (2.148), 
which falls in the interval between —n and n without any change in the spectrum 

We can determine x[n] by substituting X(e^) into the inverse Fourier trans- 
form integral of Eq. (2.133). Because the integration of X(e^ a) ) extends only over one 
period, from — n < o> < tt, we need include only the r = term from Eq. (2.148). 
Consequently, we can write 



x[n] = — / 2jt8(<o - (o )e i<on da). (2.149) 

2n J-n 

From the definition of the impulse function, it follows that 

x[n] = e jco ° n for any n. 
For o>o = 0, this reduces to the sequence considered in Example 2.23. 

Clearly, x[n] in Example 2.24 is not absolutely summable, nor is it square summable, 
and \X(e^)\ is not finite for all co. Thus, the mathematical statement 

00 00 

Y^ e Jmn e -jcon = J2 27t8(co - co + 2nr) (2.150) 



r=-oo 



must be interpreted in a special way. Such an interpretation is provided by the theory 
of generalized functions (Lighthill, 1958). Using that theory, we can rigorously extend 
the concept of a Fourier transform representation to the class of sequences that can be 
expressed as a sum of discrete frequency components, such as 

x[n] = Y^ake Jc0kn , -oo < n < oo. (2.151) 

k 

From the result of Example 2.24, it follows that 

oo 

X(e JQ >) = 5Z 5Z l7ta kKv -<*>k + 2*r) (2.152) 

r=— oo k 

is a consistent Fourier transform representation of x[n] in Eq. (2.151). 

Another sequence that is neither absolutely summable nor square summable is 
the unit step sequence u[n]. Although it is not completely straightforward to show, this 
sequence can be represented by the following Fourier transform: 

1 °° 



Sec. 2.8 Symmetry Properties of the Fourier Transform 55 

2.8 SYMMETRY PROPERTIES OF THE FOURIER 
TRANSFORM 

In using Fourier transforms, it is useful to have a detailed knowledge of the way that 
properties of the sequence manifest themselves in the Fourier transform and vice versa. 
In this section and Section 1.9, we discuss and summarize a number of such properties. 

Symmetry properties of the Fourier transform are often very useful for simplifying 
the solution of problems. The following discussion presents these properties, and the 
proofs are considered in Problems 1.72 and 1.73. Before presenting the properties, 
however, we begin with some definitions. 

A conjugate-symmetric sequence x e [n] is defined as a sequence for which x e [n] = 
x*[— n], and a conjugate-antisymmetric sequence x [n] is defined as a sequence for which 
x [n] = — x*[— n], where * denotes complex conjugation. Any sequence x[n] can be 
expressed as a sum of a conjugate-symmetric and conjugate-antisymmetric sequence. 
Specifically, 

x[n] = x e [n] + x [n], (2.154a) 

where 

Xe[n] = \(x[n] + x*[~n]) = x*[-n] (2.154b) 

and 

x [n] = \(x[n] - x*[-n\) = -x*[-n]. (2.154c) 

A real sequence that is conjugate symmetric such that x e [n] = x e [— n] is called an even 
sequence, and a real sequence that is conjugate antisymmetric such that x [n] = — x [— n] 
is called an odd sequence. 

A Fourier transform X(e^) can be decomposed into a sum of conjugate-symmetric 
and conjugate-antisymmetric functions as 

X(en = X e (e>*>) + X {e^\ (2.155a) 

where 

X e (e> a ) = \[X(e j(t> ) + X*(e~ ico )] (2.155b) 

and 

X (e jt0 ) = \[X(e jo >) - X*(e- ia )]. (2.155c) 

By substituting -co for co in Eqs. (2.155b) and (2.155c), it follows that X e (e ja) ) is conjugate 
symmetric and X o (e J0) ) is conjugate antisymmetric; i.e., 

X e (ei") = X e *(e~n (2.156a) 

and 

X (e'») = -XZ(e-i°>). (2.156b) 

If a real function of a continuous variable is conjugate symmetric, it is referred to as an 
even function, and a real conjugate- antisymmetric function of a continuous variable is 
referred to as an odd function. 

The symmetry properties of the Fourier transform are summarized in Table 1.1. 
The first six properties apply for a general complex sequence x[n] with Fourier trans- 
form X(e jco ). Properties 1 and 2 are considered in Problem 1.72. Property 3 follows from 
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TABLE 2.1 SYMMETRY PROPERTIES OF THE FOURIER TRANSFORM 





Sequence 
x[n] 


Fourier Transform 
X(e>°>) 


1. x*[n] 




X*(e~i a ) 


2. x*[-n] 




X*{e> w ) 


3. Ke{x[n]} 




X e (e }w ) (conjugate-symmetric part of X(e^ w )) 


4. jjm{x[n]) 




X {e^) (conjugate-antisymmetric part 
oiX{e^)) 


5. x e [n] (conjugate-symmetric part 


X R (ei*>) = Ke{X(e>«)} 



oix[n]) 

6. x [n] (conjugate-antisymmetric jX/(e i<0 ) = jJm{X(e i<0 )} 

paTtofx[n]) 

The following properties apply only when x[n] is real: 

7. Any real x[n] X{e j< °) = X*(e- ioi ) (Fourier transform is 

conjugate symmetric) 

8. Any real x[n] X R (e i<a ) = X R (e~ i<0 ) (real part is even) 

9. Any real ;t[/i] Xi(e^) = -Xj(e~^) (imaginary part is odd) 

10. Any real x[n] \X(e> a )\ = \X{e~^)\ (magnitude is even) 

11. Any real jc[«] <X(e }a> ) = -<X(e- ja >) (phase is odd) 

12. x e [n] (even part of x[n\) X R {e> w ) 

13. x [n] (oddpartofjc[«]) jXiie' 10 ) 

properties 1 and 2, together with the fact that the Fourier transform of the sum of two 
sequences is the sum of their Fourier transforms. Specifically, the Fourier transform of 
7le{jt[«]} = \(x[n] + x*[n]) is the conjugate-symmetric part of X(e }< °), or X e (e i( °). Sim- 
ilarly, jjm{x[n]} = \{x[n] — **[«]), or equivalently, jjm{x[n]} has a Fourier transform 
that is the conjugate-antisymmetric component X {e^) corresponding to property 4. 
By considering the Fourier transform of x e [n] and x [ri\, the conjugate-symmetric and 
conjugate- antisymmetric components, respectively, of x[n], it can be shown that prop- 
erties 5 and 6 follow. 

If x[n] is a real sequence, these symmetry properties become particularly straight- 
forward and useful. Specifically, for a real sequence, the Fourier transform is conjugate 
symmetric; i.e., X(e^) = X*(e~^) (property 7). Expressing X(e^) in terms of its real 
and imaginary parts as 

X(en = X R (en + jXj{en, (2.157) 

we can derive properties 8 and 9 — specifically, 

X R (en = X R (e~n (2.158a) 

and 

Xjiei") = -Xjie-J"). (2.158b) 

In other words, the real part of the Fourier transform is an even function, and the 
imaginary part is an odd function, if the sequence is real. In a similar manner, by 
expressing X(e }a} ) in polar form as 

X(e Jo >) = |AV*)|e' <jr < e, "\ (2.159) 
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we can show that, for a real sequence x[n], the magnitude of the Fourier transform, 
1^(^)1, is an even function of co and the phase, <X(e }CO ), can be chosen to be an odd 
function of co (properties 10 and 11). Also, for a real sequence, the even part of x[n] 
transforms to X^e* *), and the odd part of x[n] transforms to jXi{e^) (properties 12 
and 13). 



Example 2.25 Illustration of Symmetry Properties 

Let us return to the sequence of Example 2.21, where we showed that the Fourier 
transform of the real sequence x[n] = a n u[n] is 

X(e^) = — t- if \a\ < 1. (2.160) 

Then, from the properties of complex numbers, it follows that 

X(e } ") = l _l e - } „ = X*(e~n (property 7), 

XR(e JQ) ) = , 1 1 7 fl ! t ° SaJ = X R (e~n (property 8), 



\X(en\ = 



1 +a 2 — 2a cos a; 

—a sin co 
1 + a 2 — la cos co 
1 



(l + fl 2 -2flCOS£w) 1 /2 



= -Xfa-i*) (property 9), 
= \X(e~n\ (property 10), 



<X(e^) = tan" 1 [ , aSmC ° ) = -<X{e~ }ai ) (property 11). 
V 1 — a cos co 




Radian frequency (co) 
(a) 




Radian frequency (<o) 
(b) 

Figure 2.22 Frequency response tor a system with impulse response h[n] = 
a n u[n]. (a) Real part, a > 0; a = 0.9 (solid curve) and a = 0.5 (dashed curve), 
(b) Imaginary part. 
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Radian frequency (<u) 
(d) 

Figure 2.22 (Continued) (c) Magnitude, a > 0; a = 0.9 (solid curve) and 
a = 0.5 (dashed curve), (d) Phase. 



These functions are plotted in Figure 2.22 for a > 0, specifically, a — 0.9 (solid curve) 
and a = 0.5 (dashed curve). In Problem 2.43, we consider the corresponding plots for 
a <0. 



2.9 FOURIER TRANSFORM THEOREMS 

In addition to the symmetry properties, a variety of theorems (presented in Sections 
2.9.1-2.9.7) relate operations on the sequence to operations on the Fourier transform. 
We will see that these theorems are quite similar in most cases to corresponding theo- 
rems for continuous-time signals and their Fourier transforms. To facilitate the statement 
of the theorems, we introduce the following operator notation: 

X(e&) = F{x[n]} t 
x[n] = F- l [X{t!»% 



x[n] 



X(e }w \ 



That is, F denotes the operation of "taking the Fourier transform of x [«]," and T~ x is the 
inverse of that operation. Most of the theorems will be stated without proof. The proofs, 
which are left as exercises (Problem 2.74), generally involve only simple manipulations 
of variables of summation or integration. The theorems in this sectioij-are summarized 
in Table 2.2. 
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TABLE 2.2 FOURIER TRANSFORM THEOREMS 

Sequence Fourier Transform 

x[n] X(e> a ) 

y[n] Y(eJ a ) 



1. ax[n] + by[n] 










aX(el<°) + bY(e&) 


2. x[n — rid] (nd an 


integer) 






e-iwdxiei*) 


3. e'^xln] 










X( e ^ w ~ e, o)) 


4. x[~n] 










X(e-i°>) 

X*(ei m ) ifjc[n]real. 


5. nx[n] 










.dX(e> a ) 
do) 


6. x[n] * y[n] 










X{ei m )Y{ei w ) 


7. *[«]?[«] 










-!- [ X(e }6 )Y(e^ m -^)de 
2n f 


Parseval's theorem: 












n=—oo 


/ 


\X(e^) 

-n 


\\ 2 da> 






oo 

9. J2 *M/M = 

n=— oo 


1 

27T 


J X(e> 

J-7T 


<»)Y*{e> 


w )dot 





2.9 A Linearity of the Fourier Transform 

If 



and 



xi[n] <£+ XW") 



x 2 [n] <£+ X 2 (e ito ) t 



then it follows by substitution into the definition of the discrete-time Fourier transform 
that 

axi[n] + bx 2 [n] ^ aXi(e Ja ) + bX 2 (e'°>). (2.161) 

2-9.2 Time Shifting and Frequency Shifting 

If 

x[n] *£+ X(e i<0 ), 

then, for the time-shifted sequence, a simple transformation of the index of summation 
in the discrete-time Fourier transform yields 

x[n - n d ] ^ e- ic0nd X(e j(O ). (2.162) 

Direct substitution proves the following result for the frequency-shifted Fourier trans- 
fpxpi'- 

e^ n x[n] <£+ Xie^-^y (2.163) 
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2.9.3 Time Reversal 

If 

x[n] <£+ X(e j(D ), 
then if the sequence is time reversed, 

x[-n] ^> X(e^ }0) ). (2.164) 

If x[n] is real, this theorem becomes 

x[-n] +^+ X*(e j(ti ). (2.165) 

2.9.4 Differentiation in Frequency 

If 

x[n] ^> X(e^\ 

then, by differentiating the discrete-time Fourier transform, it is seen that 

. 1 t AX{e^) ,„ .„. 

nx[n] < — ► ; — t — -. (2.166) 

dco 

2.9.5 Parsevals Theorem 

If 

then 

00 



x[n] <£+ X(e>°), 



E = ^ \x[n]\ 2 = — \X(ei')\ 2 da>. (2.167) 

n=-oo J ~ n 

The function | X(e }QJ )\ 2 is called the energy density spectrum, since it determines how the 
energy is distributed in the frequency domain. Necessarily, the energy density spectrum 
is defined only for finite-energy signals. A more general form of Parseval's theorem is 
shown in Problem 2.77. 



2.9.6 The Convolution Theorem 

If 



and 
and if 



x[n] <£+ X{e>°) 



h[n] <£+ H{e>»\ 



y [n] = ^2 x[k]h[n ~k] = x[n] * h[n], (2.168) 

k=-oc f 

then 

Y(e jo >) = X(e i(0 )H(e^) t (2.169) 
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Thus, convolution of sequences implies multiplication of the corresponding Fourier 
transforms. Note that the time-shifting property is a special case of the convolution 
property, since 

8[n - n d ] ^ e- j(ond (2.170) 

and if h[n] = 8[n — n^], then y[n] = x[n] * 8[n — no] = x[n — n^]. Therefore, 

H(e ia ) = e- j(ond and Y{e j( °) = e~ J0ind X{e j<0 ). 

A formal derivation of the convolution theorem is easily achieved by applying the 
definition of the Fourier transform to y[n] as expressed in Eq. (2.168). This theorem can 
also be interpreted as a direct consequence of the eigenfunction property of complex 
exponentials for linear time-invariant systems. Recall that H(e^) is the frequency re- 
sponse of the linear time-invariant system whose impulse response is h[n]. Recall also 
that if 

x[n] = e ia>n , 
then 

y[n] = H{e i( °)e^ n . 

That is, complex exponentials are eigenfunctions of linear time-invariant systems, where 
//(e 7<u ), the Fourier transform of h[n] t is the eigenvalue. From the definition of integra- 
tion, the Fourier transform synthesis equation corresponds to the representation of a 
sequence x[n] as a superposition of complex exponentials of infinitesimal size; that is, 

x[n] = ~ I* X(e JQ >)e i0)n dw= lim J- Y X(e jkA( °)e jkAo)n Aco. 

By the eigenfunction property of linear systems and by the principle of superposition, 
the corresponding output will be 

v[n]= lim ^-Y H(e ikA0} )X(ei kA(O )e jkA(on Aa) = -?- [* H(e J6) )X(e }(0 )e }Ct,n da>. 

A(u->-0 2?r ~^ 2tc J _ n 

Thus, we conclude that 

Y(e /a ) = H(e J0} )X(e ja} l 
as in Eq, (2.169). 

2.9.7 The Modulation or Windowing Theorem 

If 



and 
and if 



x[n] ^> X(e^) 



w[n] ^> W(e j(0 ), 



y[n] = x[n]w[n], (2.171) 
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then 



Y(e ja) ) = i- P X{ei 6 )W(ei {m - 9) )de. 



(2.172) 



Equation (2.172) is a periodic convolution, i.e., a convolution of two periodic functions 
with the limits of integration extending over only one period. The duality inherent in 
most Fourier transform theorems is evident when we compare the convolution and 
modulation theorems. However, in contrast to the continuous-time case, where this du- 
ality is complete, in the discrete-time case fundamental differences arise because the 
Fourier transform is a sum while the inverse transform is an integral with a periodic 
integrand. Although for continuous time we can state that convolution in the time do- 
main is represented by multiplication in the frequency domain and vice versa, in discrete 
time this statement must be modified somewhat. Specifically, discrete-time convolution 
of sequences (the convolution sum) is equivalent to multiplication of corresponding 
periodic Fourier transforms, and multiplication of sequences is equivalent to periodic 
convolution of corresponding Fourier transforms. 

The theorems of this section and a number of fundamental Fourier transform pairs 
are summarized in Tables 2.2 and 2.3, respectively. One of the ways that knowledge of 



TABLE 2.3 FOURIER TRANSFORM PAIRS 



Sequence 



Fourier Transform 



1. S[n] 



2. S[n - n ] 


e -}(ono 


3. 1 (—oo < n < oo) 


^ 2jtS(a> + 2jTk) 




*=-oe 


4. a n u[n] (|«| < 1) 


1 



5. u[n] 



6. (n + l)a n u[n] (\a\ < 1) 



7. -r-^ -w « (|r I < 1) 



sin co c n 



nn 



r n (l, 0<n< 

9X M=\0, others 



M 
otherwise 



10. e Ja >°" 



11. cos(coon + 4>) 



00 



k=-oo 



(1 - ae-i*) 2 



1 



1 - 2r cosco p e-i<* + r 2 e-^ 

ye ' |0, <o c <\co\<n 

sin[o)(M+l)/2] ^_ fa)Af/2 
sin(a>/2) 



y 27tS(ct) — coo + 2nk) 

J=-O0 

oo 

^ [7te^B(a> -ct>o + Ink) + 7te~^5(co + co + 2nk)] 



k=-oo 
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Fourier transform theorems and properties is useful is in determining Fourier transforms 
or inverse transforms. Often, by using the theorems and known transform pairs, it is 
possible to represent a sequence in terms of operations on other sequences for which 
the transform is known, thereby simplifying an otherwise difficult or tedious problem. 
Examples 2.26-2.30 illustrate this approach. 



Example 2.26 Determining a Fourier Transform 
using Tables 2.2 and 2.3 

Suppose we wish to find the Fourier transform of the sequence x[n] = a n u[n — 5]. This 
transform can be computed by exploiting Theorems 1 and 2 of Table 2.2 and transform 
pair 4 of Table 2.3. Let x\[ri\ = a"u[n]. We start with this signal because it is the most 
similar signal to x[n] in Table 2.3. The table states that 

*i(0 = 1 * ,„ • (2-173) 

1 — ae }<° 

To obtain x [«] from x\ [«], we first delay x\ [n] by 5 samples, i.e. , X2 [n] = x\ [n — 5] . Theo- 
rem 2 of Table 2.2 gives the corresponding frequency-domain relationship, Xtie^) = 
e-J 5a} Xi(ei w ),so 

e -}5w 

* 2(e>) = r^^- ■ < 2 - 174) 

In order to get from X2[n] to the desired x[n], we need only multiply by the constant 
a 5 , i.e., x[n] = a 5 JC2[ra]. The linearity property of the Fourier transform* Theorem 1 of 
Table 2.2, then yields the desired Fourier transform, 

a 5f-j5v 

X(e Ja >) = ^. (2.175) 



Example 2.27 Determining an Inverse Fourier 
Transform Using Tables 2.2 and 2.3 



Suppose that 



X(e iw ) = t* ^ 7-^- (2.176) 

v ' (l-ae-^)(l-fte-^) } 



Direct substitution of X(e }{0 ) into Eq. (2.133) leads to an integral that is difficult to 
evaluate by ordinary real integration techniques. However, using the technique of 
partial fraction expansion, which we discuss in detail in Chapter 3, we can expand 
X(e^) into the form 

XV) = "'<" - b) - MfL^. (2 . 177) 

v ' X-ae-w I -be-} 10 v ' 

From Theorem 1 of Table 2.2 and transform pair 4 of Table 2.3, it follows that 

x[n]= (~^T)a n u[n\- (-~r )ifu[n\ (2.178) 
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Example 2.28 Determining the Impulse Response 
from the Frequency Response 

The frequency response of a highpass filter with delay is 

H(en = ( e : JQ}nd > «c<M<*' (2.179) 

' 1 0, \co\ < co c , 

where a period of 2jt is understood. This frequency response can be expressed as 

H(e^) = e- ja)nd (l - H lp (e j(a )) = e~^ nA - e- jaind H Xv {e^), 

where H\ v {e^ w ) is periodic with period 2n and 

V ^ ' 1 0, (£> c < \0)\ < JT. 

Using the result of Example 2.22 to obtain the inverse transform of H\ p (e^), together 
with properties 1 and 2 of Table 2.2, we have 

h[n] = 6[n - rid] - r[n — n d] 

sin a) c (n -rid) 



= $[n - n d ] - 



n{n - n d ) 



Example 2.29 Determining the Impulse Response 
for a Difference Equation 

In this example we determine the impulse response for a stable linear time-invariant 
system for which the input x[n] and output y[n] satisfy the linear constant-coefficient 
difference equation 

y[n] - \y[n - 1] = x[n] - \x[n - 1]. (2.180) 

In Chapter 3 we will see that the ^-transform is more useful than the Fourier transform 
for dealing with difference equations. However, this example offers a hint of the utility 
of transform methods in the analysis of linear systems. To find the impulse response, 
we set x[n] = S[n]; with h[n] denoting the impulse response, Eq. (2.180) becomes 

h[n] - \h[n - 1] = S[n] - \6[n - 1]. (2.181) 

Applying the Fourier transform to both sides of Eq. (2.181) and using properties 1 and 
2 of "Bible 2.2, we obtain 

H(e }Q >) - %e-i»H(ei a ) = 1 - J <?->", (2.182) 

or 

i - U~ }a) 

H(e }a) ) = 4 — -. (2.183) 

To obtain h[n], we want to determine the inverse Fourier transform of H(e i<0 ). Toward 
this end, we rewrite Eq. (2.183) as 

1 \£ jw 

\e~i<» 1 - \ 
From transform 4 of Table 2.3, 



H(e"°) = = : *-. — -. (2.184) 



(i)"«w 



1 - \e~l< 
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Combining this transform with property 3 of Table 2.2, we obtain 

-(l)(|)"- 1 H[n -l]^- r i^-. (2.185) 

Based on property 1 of Table 2.2, then, 

h[n] = {\) n u[n] - (l)G)"" 1 u[n - 1]. (2.186) 



2.10 DISCRETE-TIME RANDOM SIGNALS 

The preceding sections have focused on mathematical representations of discrete-time 
signals and systems and the insights that derive from such mathematical representations. 
We have seen that discrete-time signals and systems have both a time-domain and 
a frequency-domain representation, each with an important place in the theory and 
design of discrete-time signal-processing systems. Until now, we have assumed that the 
signals are deterministic, i.e., that each value of a sequence is uniquely determined by 
a mathematical expression, a table of data, or a rule of some type. 

In many situations, the processes that generate signals are so complex as to make 
precise description of a signal extremely difficult or undesirable, if not impossible. In 
such cases, modeling the signal as a stochastic process is analytically useful. As an 
example, we will see in Chapter 6 that many of the effects encountered in implementing 
digital signal-processing algorithms with finite register length can be represented by 
additive noise, i.e., a stochastic sequence. Many mechanical systems generate acoustic 
or vibratory signals that can be processed to diagnose potential failure; again, signals 
of this type are often best modeled in terms of stochastic signals. Speech signals to 
be processed for automatic recognition or bandwidth compression and music to be 
processed for quality enhancement are two more of many examples. 

A stochastic signal is considered to be a member of an ensemble of discrete-time 
signals that is characterized by a set of probability density functions. More specifically, 
for a particular signal at a particular time, the amplitude of the signal sample at that 
time is assumed to have been determined by an underlying scheme of probabilities. 
That is, each individual sample x[n] of a particular signal is assumed to be an outcome 
of some underlying random variable x n . The entire signal is represented by a collection 
of such random variables, one for each sample time, — oo < n < oo. This collection of 
random variables is called a random process, and we assume that a particular sequence 
of samples x[n] for — oo < n < oo has been generated by the random process that 
underlies the signal. To completely describe the random process, we need to specify the 
individual and joint probability distributions of all the random variables. 

The key to obtaining useful results from such models of signals lies in their de- 
scription in terms of averages that can be computed from assumed probability laws or 
estimated from specific signals. While stochastic signals are not absolutely summable or 
square summable and, consequently, do not directly have Fourier transforms, many (but 
not all) of the properties of such signals can be summarized in terms of averages such as 
the autocorrelation or autocovariance sequence, for which the Fourier transform often 
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exists. As we will discuss in this section, the Fourier transform of the autocovariance 
sequence has a useful interpretation in terms of the frequency distribution of the power 
in the signal. The use of the autocovariance sequence and its transform has another 
important advantage: The effect of processing stochastic signals with a discrete-time 
linear system can be conveniently described in terms of the effect of the system on the 
autocovariance sequence. 

In the following discussion, we assume that the reader is familiar with the basic 
concepts of stochastic processes, such as averages, correlation and covariance functions, 
and the power spectrum. A brief review and summary of notation and concepts is 
provided in Appendix A. A more detailed presentation of the theory of random signals 
can be found in a variety of excellent texts, such as Davenport (1970) and Papoulis 
(1984). 

Our primary objective in this section is to present a specific set of results that will 
be useful in subsequent chapters. Therefore, we focus on wide-sense stationary random 
signals and their representation in the context of processing with linear time-invariant 
systems. Although, for simplicity, we assume that x[n] and h[n] are real valued, the 
results can be generalized to the complex case. 

Consider a stable linear time-invariant system with real impulse response h[n]. 
Let x[n] be a real- valued sequence that is a sample sequence of a wide-sense stationary 
discrete-time random process. Then the output of the linear system is also a sample 
function of a random process related to the input process by the linear transformation 

oo oo 

y[n] = J2 h \- n ~ *]*[*] = Y, M*M" " *]• 

ks= — K> k=—oo 

As we have shown, since the system is stable, y[n] will be bounded if x[n] is bounded. We 
will see shortly that if the input is stationary, 5 then so is the output. The input signal may 
be characterized by its mean m x and its autocorrelation function xx [m], or we may also 
have additional information about first- or even second-order probability distributions. 
In characterizing the output random process y[n] we desire similar information. For 
many applications, it is sufficient to characterize both the input and output in terms of 
simple averages, such as the mean, variance, and autocorrelation. Therefore, we will 
derive input-output relationships for these quantities. 

The means of the input and output processes are, respectively, 

m Xn =€{x n }, m yn =S{y n }, (2.187) 

where £{>} denotes the expected value. In most of our discussion, it will not be necessary 
to carefully distinguish between the random variables x„ and y„ and their specific values 
x[n] and y[ri\. This will simplify the mathematical notation significantly. For example, 
Eqs. (2.187) will alternatively be written 

m x [n] = €[x[n]h m y [n] = €{y[n]}. (2.188) 

If x[n] is stationary, then m x [n] is independent of n and will be written as m x , with similar 
notation for m y [n] if y[n] is stationary. 

5 In the remainder of the text, we will use the term stationary to mean "wide-sense stationary." 
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The mean of the output process is 

CO 

m y [n] = €{y[n]} = £ h[k]S{x[n - k]}, 

fc=— CO 

where we have used the fact that the expected value of a sum is the sum of the expected 
values. Since the input is stationary, m x [n — k] = m x , and consequently, 

CO 

m y [n]=m x ^ h[k]. (2.189) 

k=— co 

From Eq. (2.189), we see that the mean of the output is also constant. An equivalent 
expression to Eq. (2.189) in terms of the frequency response is 

m y = H(ei°)m x . (2.190) 

Assuming temporarily that the output is nonstationary, the autocorrelation func- 
tion of the output process for a real input is 

4> yy [n> n + m] = S{y[n]y[n + m]} 

CO CO 



= € I J2 J2 h Wh[r]x[n - k]x[n + m-r] 



,fc=-cor=-co 

CO CO 



= S *M J2 k[r]£{x[n-k]x[n + m-r]}. 



k=—oo 



Since x[n] is assumed to be stationary, £{x[n — k]x[n + m — r]} depends only on the time 
difference m + k — r. Therefore, 

CO 00 

<p yy [n y n + m] = j^ h[r] ^ h[r]<p xx [m + k - r] = <t> yy [m]. (2.191) 

fc=-co r=-co 

That is, the output autocorrelation sequence also depends only pn the time difference 
m. Thus, for a linear time-invariant system having a wide-sense stationary input, the 
output is also wide-sense stationary. 

By making the substitution t =r — £, we can express Eq. (2.191) as 



(2.192) 



4> yy [m\= J2 <t>xAm-Z] J2 h[k]h[l + k] 

l=— co k=— co 

co 

= 53 4>xx[m-t]c hh [tl 

l=-OQ 

where we have defined 

CO 

Chh [l]= Yl h[k]h[l+k], (2.193) 



fc=— CO 



A sequence of the form of Chh[£\ is called a deterministic autocorrelation sequence 
or, simply, the autocorrelation sequence ofh[n]. It should be emphasized that c/,/,[£] is 
the autocorrelation of an aperiodic — i.e., finite-energy — sequence and should not be 
confused with the autocorrelation of an infinite-energy random sequence. Indeed, it 
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can be seen that c/,/,[£] is simply the discrete convolution of h[n] with h[—n]. Equa- 
tion (2.192), then, can be interpreted to mean that the autocorrelation of the output of 
a linear system is the convolution of the autocorrelation of the input with the aperiodic 
autocorrelation of the system impulse response. 

Equation (2.192) suggests that Fourier transforms may be useful in characteriz- 
ing the response of a linear time-invariant system to a stochastic input. Assume, for 
convenience, that m x = 0; i.e., the autocorrelation and autoco variance sequences are 
identical. Then, with <b X x{e ia> )> ^ yy (e jeo ), and Chh(e jto ) denoting the Fourier transforms 
of 4> xx [m], 0^[w], and q,/,[£], respectively, from Eq. (2.192), 

^ yy (en = C hh (en* xx (en. (2.194) 

Also, from Eq. (2.193), 

C hh (en = H(enW(en 

= \H(en\\ 



so 



* yy (en = \H(en\ 2 ^ xx (en. (2.195) 

Equation (2.195) provides the motivation for the term power density spectrum. Specifi- 
cally, 



S{y 2 [n]} = 4>yy[0] = ^£ *„&") <*» 



(2.196) 
= total average power in output. 

Substituting Eq. (2.195) into Eq. (2.196), we have 

8{y 2 [n]} = 4> yy [0] = ^f_ \H(en\ 2 <P xx (enda>. (2.197) 

Suppose that H(e^) is an ideal bandpass filter, as shown in Figure 2.18(c). We recall 
that <p xx [m] is an even sequence, so 

Likewise, \H(e^)\ 2 is an even function of ox Therefore, we can write 
^[0] = average power in output 

1 fVb i r-o>a (2.198) 

= =- / *xx(e ia ) dco+— <S> xx (e j< °) dco. 

m J<o a In j^ 

Thus, the area under ^^(e^) for co a < \co\ < coi, can be taken to represent the mean- 
square value of the input in that frequency band. We observe that the output power 
must remain nonnegative, so 

lim <M0]>0. 

This result, together with Eq. (2.198) and the fact that the band w a < co < w b can be 
arbitrarily small, implies that 

Qxxie'*) > for all a>. (2.199) 

Hence, we note that the power density function of a real signal is real, even, and non- 
negative. 
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Example 2.30 White Noise 

The concept of white noise is exceedingly useful in quantization error analysis. A 
white-noise signal is a signal for which ^[m] = o^5[m]. We assume in this example 
that the signal has zero mean. The power spectrum of a white noise signal is a constant, 
i.e., 

<P xx (e Jt0 ) = <*l for all <w. 

The average power of a white-noise signal is therefore 

***[0] = ~ J ^ xx (e^)dco = ±- J o 2 x da> = o 2 x . 

The concept of white noise is also useful in the representation of random signals 
whose power spectra are not constant with frequency. For example, a random signal 
y[n] with power spectrum <t> yy (e }<0 ) can be assumed to be the output of a linear time- 
invariant system with a white-noise input. That is, we use Eq. (2.195) to define a system 
with frequency response H(e ja> ) to satisfy the equation 

* w ,(0 = |H(Ol 2 a, 2 , 

where a 2 is the average power of the assumed white-noise input signal. We adjust 
the average power of this input signal to give the correct average power for y[ri\. For 
example, suppose that h[n] = a"u[n]. Then 

H{e ja> ) = 



1 - ae-i* ' 
and we can represent all random signals whose power spectra are of the form 



*«>(«'") = 



1 - ae-* 1 



2 "x 



<Tv = 



1 + a 2 — 2a cos co 



Another important result concerns the cross-correlation between the input and 
output of a linear time-invariant system: 

4> xy [m] = £{x[n]y[n + m]} 

= £ \ x[n] JT h lk]x[n + m - k] 1 (2.200) 

= J2 h[k]4>xx[m-kl 

k=—oo 

In this case, we note that the cross-correlation between input and output is the convo- 
lution of the impulse response with the input autocorrelation sequence. 
The Fourier transform of Eq. (2.200) is 

4> xy (e*») = H(en<*>xx(en. (2.201) 

This result has a useful application when the input is white noise, i.e., when <t> xx [m] = 
cr^S[m\. Substituting into Eq. (2.198), we note that 

<t> xy [m] = cr x h[m]. (2.202) 
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That is, for a zero-mean white-noise input, the cross-correlation between input and 
output of a linear system is proportional to the impulse response of the system. Similarly, 
the power spectrum of a white-noise input is 

$ xx (e jco ) = c£ -n < oj < n. (2.203) 

Thus, from Eq. (2.201), 

<t> xy (e>») = a 2 x H(e jw ). (2.204) 

In other words, the cross power spectrum is in this case proportional to the frequency 
response of the system. Equations (2.202) and (2.204) may serve as the basis for esti- 
mating the impulse response or frequency response of a linear time-invariant system if 
it is possible to observe the output of the system in response to a white -noise input. 



2.11 SUMMARY 

In this chapter, we have considered a number of basic definitions relating to discrete- 
time signals and systems. We considered the definition of a set of basic sequences, the 
definition and representation of linear time-invariant systems in terms of the convolu- 
tion sum, and some implications of stability and causality. The class of systems for which 
the input and output satisfy a linear constant-coefficient difference equation with initial 
rest conditions was shown to be an important subclass of linear time-invariant systems. 
The recursive solution of such difference equations was discussed and the classes of FIR 
and IIR systems defined. 

An important means for the analysis and representation of linear time-invariant 
systems lies in their frequency-domain representation. The response of a system to a 
complex exponential input was considered, leading to the definition of the frequency 
response. The relation between impulse response and frequency response was then 
interpreted as a Fourier transform pair. 

We called attention to many properties of Fourier transform representations and 
discussed a variety of useful Fourier transform pairs. Tables 2.1 and 2.2 summarize the 
properties and theorems, and Table 2.3 contains some useful Fourier transform pairs. 

The chapter concludes with an introduction to discrete-time random signals. These 
basic ideas and results will be developed further and used in later chapters. 

Although the material in this chapter was presented without direct reference to 
continuous-time signals, an important class of discrete-time signal-processing problems 
arises from sampling such signals. In Chapter 4 we consider the relationship between 
continuous-time signals and sequences obtained by periodic sampling. 



PROBLEMS 



Basic Problems with Answers 

2.1. For each of the following systems, determine whether the system is (1) stable, (2) causal, 
(3) linear, (4) time invariant, and (5) memoryless: 
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(a) T(x[n\) = g[n]*[n] with g[n] given 

(b) 7X*M) = 5X^*1*] 

(c) T(x[n]) = j:t7-nA k '\ 

(d) T(x[n]) = x[n- no] 

(e) T(x[n]) = ^W 

(f) T(x[n]) = ax[n] + b 

(g) r(*[nj)=*[-n] 

(h) T(j«:[n]) = x[n] + 3«[n + 1] 

2.2. (a) The impulse response h[n] of a linear time-invariant system is known to be zero, except 

in the interval Nq <n < N\. The input x [n] is known to be zero, except in the interval 
N2 < n < N$. As a result, the output is constrained to be zero, except in some interval 
N4 <n < N5. Determine N4 and N5 in terms of No, Ni, N2, and JV3. 
(b) If x [n] is zero, except for N consecutive points, and h[n] is zero, except for M consecutive 
points, what is the maximum number of consecutive points for which y[n] can be 
nonzero? 

2.3. By direct evaluation of the convolution sum, determine the step response of a linear time- 
invariant system whose impulse response is 

h[n] = a~ n u[—n], < a < 1. 

2.4. Consider the linear constant-coefficient difference equation 

y[n] ~ bin - 1] + \y[n - 2] = 2x[n - 1]. 
Determine y[n] for n > when x[n] = 8[n] and y[n] = 0, n < 0. 

2.5. A causal linear time-invariant system is described by the difference equation 

y[n] - 5y[n - 1] + 6y[n - 2] = 2x[n - 1]. 

(a) Determine the homogeneous response of the system, i.e., the possible outputs if x[n] = 
for all n. 

(b) Determine the impulse response of the system. 

(c) Determine the step response of the system. 

2.6. (a) Find the frequency response H{e i<0 ) of the linear time-invariant system whose input 

and output satisfy the difference equation 

y[n] — \y[n — 1] = x[n] + 2x[n - 1] 4- x[n — 2]. 
(b) Write a difference equation that characterizes a system whose frequency response is 

H{e }a} ) = ^— = — — . 

1 + \e-i a + \e-i*° 

2.7. Determine whether each of the following signals is periodic. If the signal is periodic, state 
its period. 

(a) x[n] = ^'(*«/6) 

(b) x[n] = e;( 3jr "/4) 

(c) x[n] = [sin(7rw/5)]/(7rn) 

(d) x[n] = e^ n ^ 

2.8. An LTI system has impulse response h[n] = 5(— l/2) n u[ri\. Use the Fourier transform to 
find the output of this system when the input is x[n] = (l/3) n u[n\. 

2.9. Consider the difference equation 

5 11 

y\n\ ~ ^y[ n - 1] + ^y[n -2] = -x[n - 1]. 
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(a) What are the impulse response, frequency response, and step response for the causal 
LTI system satisfying this difference equation. 

(b) What is the general form of the homogeneous solution of the difference equation? 

(c) Consider a different system satisfying the difference equation that is neither causal nor 
LTI, but that has y[0] = y[l] — 1. Find the response of this system to x[n] = 8[n]. 

2.10. Determine the output of a linear time-invariant system if the impulse response h[n] and 
the input x[n] are as follows: 

(a) x[n] = u[n] and h[ri\ = a n u[—n - 1], with a > 1. 

(b) x[n] = u[n - 4] and h[n] = 2 n u[-n - 1]. 

(c) x[n] = u[n] and h[n] = (Q.5)2 n u[-n\. 

(d) h[n] = 2 n u[-n - 1] and x[n] = u[n] - u[n - 10] 

Use your knowledge of linearity and time invariance to minimize the work in Parts (b)-(d). 

2.11. Consider an LTI system with frequency response 

1 _ g-/2w 

H(e JW ) = = — , -7T <co< jr. 

l+i c -;4«' 

Determine the output y[n] for all n if the input x[n] for all n is 

*[n] = sin(™J. 

2.12. Consider a system with input x[n] and output y[n] that satisfy the difference equation 

y[n] =ny[n-l]+x[n]. 

The system is causal and satisfies initial-rest conditions; i.e., if x[n] =0 for n < no, then 
y[n] = for n < »o- 

(a) If x[n] — S[n], determine y[n] for all n. 

(b) Is the system linear? Justify your answer. 

(c) Is the system time invariant? Justify your answer. 

2.13. Indicate which of the following discrete-time signals are eigenfunctions of stable, linear 
time-invariant discrete-time systems: 

(a) e }2nnl * 

(b) 3" 

(c) 2"u[-«-l] 

(d) cos(a>ott) 

(e) (1/4)" 

(f) (l/4) n u[n]+4 n u[-n-l] 

2.14. A single input-output relationship is given for each of the following three systems: 

(a) System A: x[n] = (1/3)", y[n] = 2(l/3) rt . 

(b) System B: x[n] = (1/2)", y[n] = (1/4)". 

(c) System C: x[n] = (2/3) n u[n], y[n] = 4(2/3) n u[n] - 3(l/2) n u[n]. 

Based on this information, pick the strongest possible conclusion that you can make about 
each system from the following list of statements: 
(i) The system cannot possibly be LTI. 
(ii) The system must be LTI. 
(iii) The system can be LTI, and there is only one LTI system that satisfies this input-output 

constraint, 
(iv) The system can be LTI, but cannot be uniquely determined from the information in 

this input-output constraint. 
If you chose option (iii) from this list, specify either the impulse response h[n] or the 
frequency response H(e^) for the LTI system. 
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2.15. Consider the system illustrated in Figure P2.15-1. The ouput of an LTI system with an 
impulse response h[n] = ( J) u[n + 10] is multiplied by a unit step function u[n] to yield 
the output of the overall system. Answer each of the following questions, and briefly justify 
your answers: 



x[n] 



h[n] = (V4) n u[n + 10] 




Figure P2.15-1 



(a) Is the overall system LTI? 

(b) Is the overall system causal? 

(c) Is the overall system stable in the BIBO sense? 

2.16. Consider the following difference equation: 

y [n] - -y[ n - 1] - -y[n - 2] = 3x[n]. 

(a) Determine the general form of the homogeneous solution to this difference equation. 

(b) Both a causal and an anticausal LTI system are characterized by this difference equa- 
tion. Find the impulse responses of the two systems. 

(c) Show that the causal LTI system is stable and the anticausal LTI system is unstable. 

(d) Find a particular solution to the difference equation when x[n] — (l/2)"w[/i]. 

2.17. (a) Determine the Fourier transform of the sequence 



(b) Consider the sequence 



r[n] = 


It 


< n < M, 
otherwise. 


1 
2 


1- 


cos 


, M ) 


, < n < M, 


0, 








otherwise. 



w[n] — 



Sketch w[n] and express W(e^), the Fourier transform of w[n], in terms of R (e^), the 
Fourier transform of r[n]. (Hint: First express w[n] in terms of r[n] and the complex 
exponentials e^ 2nn ^ and e -/(2™/A0.) 
(c) Sketch the magnitude of R(e ia) ) and W(e^) for the case when M = 4. 

2.18. For each of the following impulse responses of LTI systems, indicate whether or not the 
system is causal: 

(a) h[n] = (l/2) n M [«] 

(b) h[n] = (l/2)"w[« - 1] 

(c) h[n] = (l/2)l"l 

(d) h[n] = u[n + 2] - u[n - 2] 

(e) h[n] = (l/3) n «[n] + 3 n u[-n - 1] 

2.19. For each of the following impulse responses of LTI systems, indicate whether or not the 
system is stable: 

(a) h[n] = 4 n u[n] 

(b) h[n] = u[n] - u[n - 10] 

(c) h[n] = 3 n u[-n -1] 
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(d) h[n] = sin(7r«/3)«[«] 

(e) h[n] = (3/4)l fl l cos(;r n/4 + n/4) 

(f) h[n] = 2«[« + 5] - m[«] - u[n - 5] 

2.20. Consider the difference equation representing a causal LTI system 

y[n] + (l/a)y[n-l] = x[n-ll 

(a) Find the impulse response of the system, h[n], as a function of the constant a. 

(b) For what range of values of a will the system be stable? 



Basic Problems 

2.21. Consider an arbitrary linear system with input x[n] and output y[n]. Show that if x[n] = 
for all n, then y[n] must also be zero for all n. 

2.22. For each of the pairs of sequences in Figure P2.22-1, use discrete convolution to find the 
response to the input x[n] of the linear time-invariant system with impulse response h[ri\. 



x[n] 

, , r , , 

• • — ■ — • — • — 

1 



2 *M 

1 



1 



h[n] 

I 1 , , 



(a) 



.2 h[n] 



^r 



-• — •- 



1 



L 



1 2 n 



(b) 



*["] 



h[n] 



.,,, '11111 ,,,, 'HMll ,, . 111111 , 
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-• — • ♦ » » ■ 

« 12 

(c) 


3 


4 5 


_i 1 « » » — • 1 1 ■ ■ 1*999 
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2< 


> 


*[n] 






h[n] 


,.. *i 


11 








, , /?! . .1? , , 


-2 12 


(d) 






2 3 45 n 






Figure P2.22-1 









2.23. Using the definition of linearity (Eqs. (2.26a)-(2.26b)), show that the ideal delay system 
(Example 2.3) and the moving-average system (Example 2.4) are both linear systems. 



Chap. 2 Problems 



75 



2.24. The impulse response of a linear time-invariant system is shown in Figure P2.24-1. Deter- 
mine and carefully sketch the response of this system to the input x[n] = u[n — 4]. 



h[n] 



'mi 



4 5 



12 3 



-2 * 

Figure P2.24-1 

2.25. A linear time-invariant system has impulse response h[n] = u[ri\. Determine the response 
of this system to the input x[n] shown in Figure P2.25-1 and described as 



x[n] = 



jn-N 2 



n<0, 

< n < N\, 

N\ < n < N2, 
Ni<n S'Ni + Nx, 
Ni + N\ < n, 



where < a < 1. 



x[n] 



a (n-N 2 ) 







N, 



M 



N 2 + N x n 



Figure P2.25-1 



2.26. Which of the following discrete-time signals could be eigenfunctions of any stable LTI 
system? 

(a) S H u[n] 

(b) e> 2u,n 

(d) 5" 

(e) 5 n -^' 2ft,/ ' 

2.27. Three systems A, B, and C have the inputs and outputs indicated in Figure P2.27-1. Deter- 
mine whether each system could be LTI. If your answer is yes, specify whether there could 
be more than one LTI system with the given input-output pair. Explain your answer. 



(*)"■ 



System A 



(W 



,}nl% 



u[n) 



System B 



■+- 2e> nls u[n] 



Jn/8 



System C 



■*- 2ei" m 



Figure P2.27-1 
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2.28. Determine which of the following signals is periodic. If a signal is periodic, determine its 
period. 

(a) x[n] = eiV* n W 

(b) x[n] = sin(;r«/19) 

(c) x[n] = ne }nn 

(d) x[n] = e> n 

2.29. A discrete-time signal x[ri\ is shown in Figure P2.29-1. 



x[n] 



-2-1 12 3 4 



Figure P2.29-1 



Sketch and label carefully each of the following signals: 

(a) x[n — 2] 

(b) x[4-n] 

(c) x[2n] 

(d) x[n]u[2 - n] 

(e) x[n - l]S[n - 3] 

2.30. For each of the following systems, determine whether the system is (1) stable, (2) causal, 
(3) linear, and (4) time invariant. 

(a) T(jc[«]) = (cos7rn)x[n] 

(b) T(x[n])=x[n 2 ] 

(c) W) = 4«]EL«[«-^] 

(d) IWn]) = ££»-!*[« 

2.31. Consider the difference equation 

y[n] + j§y[n - 1] - ^y[n - 2] = x[n]. 

(a) Determine the general form of the homogeneous solution to this equation. 

(b) Both a causal and an anticausal LTI system are characterized by the given difference 
equation. Find the impulse responses of the two systems. 

(c) Show that the causal LTI system is stable and the anticausal LTI system is unstable. 

(d) Find a particular solution to the difference equation when x[n] = (3/5)" u[n]. 

232. Consider an LTI system with frequency response 



tf(c>") = «-><"-*> 



1 + le-i 2w 



—71 < CO < 7T. 



Determine the output y[n] for all n if the input for all n is 

*[/!]= COS (y)' 



2,33. Consider an LTI system with \H(e>*>)\ = 1, and let arg[//(e^)] be as shown in Fig- 
ure P2.33-1. If the input is 



x[n] = cos ( -^-n + ^ 



determine the output y[ri\. 
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Slope = - 1/3 



-tt/2 



-5tt/6 



*Tg[H(en] 

5tt/6 

tt/2 




Slope = - 1/3 



Figure P2.33-1 



2.34. The input-output pair shown in Figure P2.34-1 is given for a stable LTI system. 



*oN 



'! I 1 — 

-• 1 » ■ • • -• • • 1 1 » 

' 3 J 



-1 1 



-24 



2 y [n] 

1 



-• •- 



12 



Figure P2.34-1 



(a) Determine the response to the input x\[n] in Figure P2.34-2. 
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Figure P2.34-2 



(b) Determine the impulse response of the system. 



Advanced Problems 



2.35. The system T in Figure P2.35-1 is known to be time invariant. When the inputs to the system 
are xi[n], x% [n], and x$\n\ the responses of the system are yi[n], y% [n], and y?>[n], as shown. 
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?2 



Xl [n] 



r 



1 



-• — •- 



-• — » • • 



3 ydn] 



1 2 



x 2 [n] 



t2 



• • • ' ♦ 
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t2 



yz[«] 



12 3 
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73 M 
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Figure P2.35-1 



(a) Determine whether the system T could be linear. 

(b) If the input x[n] to the system T is 8[n], what is the system response y[n]7 

(c) What are all possible inputs x[n] for which the response of the system T can be deter- 
mined from the given information alone? 

2.36. The system Lin Figure P2.36-1 is known to be linear. Shown are three output signals y\[ri\, 
y2[ri\ y and yj{n\ in response to the input signals xi[n], X2[n], and xi[n], respectively. 



Xl [n] 
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> • — i 1 1 — •- 
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-• — •- 



-2 -1 1 2, 



-3* 



Figure P2.36-1 
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(a) Determine whether the system L could be time invariant. 

(b) If the input x[n] to the system L is S[w], what is the system response y[n]7 

2.37. Consider a discrete-time linear time-invariant system with impulse response h[ri\. If the 
input x[n] is a periodic sequence with period N (i.e., if x[n] = x[n + iV]), show that the 
output y[n] is also a periodic sequence with period N. 

2.38. In Section 2.5, we stated that the solution to the homogeneous difference equation 

N 

]TfljOfc[«-*]=0 (P2.38-1) 

Jt=0 

is of the form 

N 

y h [n\ = Y. A ^ n m> (P2.38-2) 

m=l 

with the Am's arbitrary and the z m 's the N roots of the polynomial 

N 



]TW-* = 0; (P2.38-3) 



Jt=0 

i.e., 

N N 

J2 a kZ~ k = II (1 - ZmZ ~^' (P2.38-4) 

Jt=0 m= 1 

(a) Determine the general form of the homogeneous solution to the difference equation 

y[n] - \y[n - 1] + \y[n - 2] = 2x[n - 1]. (P2.38-5) 

(b) Determine the coefficients A m in the homogeneous solution if }>[— 1] = 1 and y[0] = 0. 

(c) Now consider the difference equation 

y[n]-y[n-l] + \y[n-2]=2y[n-l]. (P2.38-6) 

If the homogeneous solution contains only terms of the form of Eq. (P2.38-2), show 
that the initial conditions y[— 1] = 1 and y[0] =0 cannot be satisfied. 

(d) If Eq. (P2.38-3) has two roots that are identical, then, in place of Eq. (P2.38-2), y h [n] 
will take the form 

JV-l 

y h [n] = Y, A ^m + "*iz" • (P2.38-7) 

m=l 

where we have assumed that the double root is z\. Using Eq. (P2.38-7), determine 
the general form of >/,[«] for Eq. (P238-6). Verify explicitly that your answer satisfies 
Eq. (P2.38-6) with x[n] = 0. 

(e) Determine the coefficients A\ and B\ in the homogeneous solution obtained in Part (d) 
if>,[-l] = land)>[0]:=0. 

2.39. Consider a system with input x [n] and output y[n]. The input-output relation for the system 
is defined by the following two properties: 

1. y[n] - ay[n - 1] = x[n], 

2. y[Q] = 1. 

(a) Determine whether the system is time invariant. 

(b) Determine whether the system is linear. 
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(c) Assume that the difference equation (property 1) remains the same, but the value y[0] 
is specified to be zero. Does this change your answer to either Part (a) or Part (b)? 

2.40. Consider the linear time-invariant system with impulse response 

M w l = ( o ) M ["]' where ;' = y — 1. 

Determine the steady-state response, i.e., the response for large n, to the excitation 

x[n] = cos(7t n)u[n]. 

2.41. A linear time-invariant system has frequency response 



H(e iw ) = 



°- 16 2 - N -' r - 



The input to the system is a periodic unit-impulse train with period N = 16; i.e., 

oo 



k=— oo 



Find the output of the system. 
2.42. Consider the system in Figure P2.42-1. 



x[n) 



o-~ 



/2 1 [rt]=/3 5[«-l] 



h 2 [n] = a n u[n] 



y[n) 



h[n] 



Figure P2.42-1 



(a) Find the impulse response h[n] of the overall system, 

(b) Find the frequency response of the overall system. 

(c) Specify a difference equation that relates the output y[n] to the input x[n], 

(d) Is this system causal? Under what condition would the system be stable? 

2.43. For X(e }0> ) = 1/(1 — ae~i w ), with -1 < a < 0, determine and sketch the following as a 
function of co: 

(a) 7le{X(en) 

(b) Jm{X(e'»)} 

(c) \X(e^)\ 

(d) <AV") 

2.44. Let X(e^) denote the Fourier transform of the signal x[n] shown in Figure P2.44-1. Perform 
the following calculations without explicitly evaluating X(e^): 
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-3 



j -' -• ° 



i'I r ih 



x[n] 



J 



2 3 4 5 6 



Figure P2.44-1 



(a) Evaluate X(e^)U =0 . 

(b) Evaluate X(e^)L =jr . 

(c) Find <jr(e> w ). 

(d) Evaluate /* ff X(ef a )da>. 

(e) Determine and sketch the signal whose Fourier transform is X(e~i w ). 

(f) Detennine and sketch the signal whose Fourier transform is TZe{X(e^ <0 )}. 

2.45. For the system in Figure P2.45-1, determine the output y[n] when the input x[n] is 8[n] and 
H(e^) is an ideal lowpass filter as indicated, i.e., 



13 1 * I - w/2<M<w. 



*[«] 



H^H 



r? 



w[«] 



(-1)" 



(-l)Mn] 



0- 



yW 



-2tj- 



H(e> a ) 



-IT 



2 



7T 
2 



IT 



2tt 



Figure P2.45-1 



2.46. A sequence has the discrete-time Fourier transform 

1-a 2 



X(e }(0 ) = 



(1 - ae-J m )(l - aei*>) ' 



\a\ <1. 



(a) Find the sequence x[ri\. 

(b) Calculate /" ff X(ei w )ca&(a>)da>/2x. 

2.47. A linear time-invariant system is described by the input-output relation 

y[n] = x [n] + 2x[n - 1] + x[n - 2]. 

(a) Determine /i[w], the impulse response of the system. 

(b) Is this a stable system? 

(c) Determine i/(e ;(y ), the frequency response of the system. Use trigonometric identities 
to obtain a simple expression for H(e> w ). 



82 Discrete-Time Signals and Systems Chap. 2 

(d) Plot the magnitude and phase of the frequency response. 

(e) Now consider a new system whose frequency response is H\{e^) = H(e^ (a+7t ^). De- 
termine h\[n], the impulse response of the new system. 

2.48. Let the real discrete-time signal x[n] with Fourier transform X(e^) be the input to a system 
with the output defined by 



n * \ 0, other 



even, 
otherwise. 



(a) Sketch the discrete-time signal s[n] = 1 + cos(jrn) and its (generalized) Fourier trans- 
form S(ei°>). 

(b) Express Y(e^), the Fourier transform of the output, as a function of X(e^) and S(e i( °). 

(c) You would like to approximate x[n] by the interpolated signal w[ri\ = y[n] + 
(l/2)(y[n + 1] + y[n — 1]). Determine the Fourier transform W(e' }< °) as a function 
of y (<?>»). 

(d) Sketch ^(e''°0,y Cc'"™), and W^) for the case when *[«] = sin(7T n / a) /(yzn/ a) and a > 
1 . Under what conditions is the proposed interpolated signal w [n] a good approximation 
for the original x[n], 

2.49. Consider a discrete-time LTI system with frequency response H(e ]a> ) and corresponding 
impulse response h[ri\. 

(a) We are first given the following three clues about the system: 

(i) The system is causal. 

(ii) H{el°>) = H*(e~^). 
(iii) The DTFT of the sequence h[n + 1] is real. 
Using these three clues, show that the system has an impulse response of finite duration. 

(b) In addition to the preceding three clues, we are now given two more clues: 

(iv) J- f H(el»)du = 2. 



(v) H(e1*) = 0. 

Is there enough information to identify the system uniquely? If so, determine the 
impulse response h[n]. If not, specify as much as you can about the sequence h[n]. 

2.50. Consider the three sequences 

v[n] = u[n] - u[n - 6], 
w[n] = 8[n] + 2S[n - 2] + S[n - 4], 
q[n] = v[n] *w[n] t 

(a) Find and sketch the sequence q[n]. 

(b) Find and sketch the sequence r[n] such that r[n] * v[n] = YHZ-oo ^ W ■ 

(c) Is q[— n] = v[—n] * w[—n]7 Justify your answer. 

2.51. A linear time-invariant system has impulse response h[n] = a n u[n\ 

(a) Determine yi[n], the response of the system to the input x^[n] = e^ n/2 ^ n . 

(b) Use the result of Part (a) to help to determine y2[n], the response of the system to the 
input xi[n\ = cos(jrn/2). 

(c) Determine y^[n] y the response of the system to the input x^[n] = e^" fTfn u[n\. 

(d) Compare ys[n] with y\[n] for large n. 
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2.52. The frequency response of an LTI system is 

H(e ia >) = e- ico/ \ -n <co<n. 

Determine the output of the system, y[n], when the input is x[n] = cos(57r«/2). Express 
your answer in as simple a form as you can. 

2.53. Consider the cascade of LTI discrete-time systems shown in Figure P2.53-1. 



x[n] 



LTI system 

#1 



w[n] 



LTI system 

#2 



y[n] 



Figure P2.53-1 



The first system is described by the equation 



Jo\ — J ' 



\co\ < O.Sir, 
0,5tv < \o)\ < jt, 

and the second system is described by the equation 

y[n] = w[n] - w[n — 1]. 

The input to this system is 

x[n] = cos(0.67r«) + 3<S[« - 5] + 2. 

Determine the output y[n]. With careful thought, you will be able to use the properties of 
LTI systems to write down the answer by inspection. 

2.54. Consider an LTI system with frequency response 

H(e J ») = e-'"K»' 2 > + WW , -it <q)<tt. 
Determine y[n], the output of this system, if the input is 

for all n. 

2.55. For the system shown in Figure P2.55-1, System 1 is a memoryless nonlinear system. System 
2 determines the value of A according to the relation 

100 
n=0 



x[n] 



System 1 



w[n] 



LTI 
Stable 



y[n] 



System 2 



Figure P2.55-1 



Specifically, consider the class of inputs of the form x[n] = cos(con), with o) a real finite 
number. Varying the value of co at the input will change A; i.e., A will be a function of to. In 
general, will A be periodic in col Justify your answer. 

2.56. Consider a system 5 with input x[n] and output y[n] related according to the block diagram 
in Figure P2.56-1. 



x[n] 



-<*> 



-}mn 



LTI system 
h[n] 



•*-y[n] 



Figure P2.56-1 
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The input x[n] is multiplied by e~^ Qfl , and the product is passed through a stable LTI system 
with impulse response h[ri\. 

(a) Is the system S linear? Justify your answer. 

(b) Is the system S time invariant? Justify your answer. 

(c) Is the system S stable? Justify your answer. 

(d) Specify a system C such that the block diagram in Figure P2.56-2 represents an alterna- 
tive way of expressing the input-output relationship of the system 5. (Note: The system 
C does not have to be an LTI system.) 



x[n] *- h[n]ei mon 



+-y[*] 



Figure P2.56-2 



2.57. An ideal lowpass filter with zero delay has impulse response h\ p [n] and frequency response 

M ^ 6 >- \0, 027t<\(O\<7T. 

(a) A new filter is defined by the equation h\[ri\ = (-l)"^i P [n] = e i7Tn h\p[n]. Determine 
an equation for the frequency response of H\(e^) y and plot the equation for \a>\ <ii. 
What kind of filter is this? 

(b) A second filter is defined by the equation h2[n] = 2h\ p [n]cos(0.5nn). Determine the 
equation for the frequency response Hi(e ia!> ), and plot the equation for |a>| < tz. What 
kind of filter is this? 

(c) A third filter is defined by the equation 

sin(O.brn) 

h 3 [n] = /iUm]. 

nn 

Determine the equation for the frequency response H$(e ia) ), and plot the equation for 
\o>\ <7i. What kind of filter is this? 

2.58. The LTI system 



\ 7. -7T <a> <0, 



is referred to as a 90° phase shifter and is used to generate what is referred to as an analytic 
signal w[n] as shown in Figure P2.58-1. Specifically, the analytic signal w[n] is a complex- 
valued signal for which 

7le[w[n]} = x[n] t 
Im{w[n]} = y[ri\. 



x[n] 



-*~ <3le {w[n]} 



H(eS*) 



>~$m{w[n]} 

y\."1 Figure P2.58-1 



If X{e^) is as shown in Figure P2.58-2, determine and sketch W(e ico ), the Fourier transform 
of the analytic signal w[n] = x[n] + jy[n]. 
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<3le [X(e^) 




$m[X(e> ,a )}=0 



— IT 



Figure P2.58-2 
2.59. The autocorrelation sequence of a signal x[n] is defined as 



R x [n]= ^ **[k]x[n + k]. 



k=—vo 

(a) Show that for an appropriate choice of the signal g[n], R x [n] = x[n] * g[n], and identify 
the proper choice for g[ri\. 

(b) Show that the Fourier transform of R x [n] is equal to |X(e ;w )| 2 . 

2.60. The signals x[n] and y[n] shown in Figure P2.60-1 are the input and corresponding output 
for an LTI system. 



tl 







x[n] 



-* — •- 



y[n] 







-• — •- 



- 1 * -1* • Figure P2.60-1 

(a) Find the response of the system to the sequence X2[n] in Figure P2.60-2. 

It x 2 [n] 



- 1 * Figure P2.60-2 

(b) Find the impulse response h[n] for this LTI system. 
2.61. Consider a system for which the input x[n] and output y[n] satisfy the difference equation 

y[n]-\y[n-l]=x[n] 

and for which y[—l] is constrained to be zero for every input. Determine whether or not 
the system is stable. If you conclude that the system is stable, show your reasoning. If you 
conclude that the system is not stable, give an example of a bounded input that results in 
an unbounded output. 



Extension Problems 

2.62. The causality of a system was defined in Section 2.2.4. From this definition, show that, for 
a linear time-invariant system, causality implies that the impulse response h[n] is zero for 
n < 0. One approach is to show that if h[n] is not zero for n < 0, then the system cannot 
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be causal. Show also that if the impulse response is zero for n < 0, then the system will 
necessarily be causal. 

2.63. Consider a discrete-time system with input x[n] and output y[n\. When the input is 



the output is 



*M = I 4 



>M= 2 



u[n], 



for all n. 



Determine which of the following statements is correct: 

• The system must be LTI. 

• The system could be LTI. 

• The system cannot be LTI. 

If your answer is that the system must or could be LTI, give a possible impulse response. If 
your answer is that the system could not be LTI, explain clearly why not. 

2.64. Consider an LTI system whose frequency response is 

H(e> w ) = e~ ja}/2 t \a>\ < jr. 
Determine whether or not the system is causal. Show your reasoning. 

2.65. In Figure P2.65-1, two sequences x\ [n] and X2[n] are shown. Both sequences are zero for all 
n outside the regions shown. The Fourier transforms of these sequences are X\(e^ w ) and 
Xiiei* ), which, in general, can be expected to be complex and can be written in the form 

Xi(e im ) = Ai(oj)e^ (a,) , 

X 2 (ei») = A 2 (co)e^ a> \ 

where Ai(co), 0i(a>), A2(a>), and $2(0)) are all real functions chosen so that both Ai(co) and 
A2(co) are nonnegative at co = 0, but otherwise can take on both positive and negative 
values. Determine appropriate choices for 0i(o>) and 02(a), and sketch these two phase 
functions in the range < co < 2jt. 
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Figure P2.65-1 



Chap. 2 Problems 



87 



2.66. Consider the cascade of discrete- time systems in Figure PI. 66-1. The time-reversal systems 
are denned by the equations f[n] = e[—n] and y[n] = g[— «]. Assume throughout the 
problem that x[n] and h\[n] are real sequences. 



















" i 




LTI 

system 

h\[n\ 

H x {en 


Time- 
reversal 
system 


LTI 

system 
hl[n] 


Time- 
reversal 
system 




x[n] | 


e[n] 


/[«] 


g[n] 


1 y[n 















Figure P2.66-1 

(a) Express E (e^), F(e><°), G (e ja} ), and Y(e^) in terms of X{e ja >) and Hi(e>°>). 

(b) The result from Part (a) should convince you that the overall system is LTI. Find the 
frequency response H{e^) of the overall system. 

(c) Determine an expression for the impulse response h[n] of the overall system in terms 
ofhi[n]. 

2.67. The overall system in the dotted box in Figure PI. 67-1 can be shown to be linear and time 
invariant. 

(a) Determine an expression for H(e^), the frequency response of the overall system from 
the input x[n] to the output y[n], in terms of H\{e^), the frequency response of the 
internal LTI system. Remember that (—1)" = e }7in . 

(b) Plot H(e^ a) ) for the case when the frequency response of the internal LTI system is 



H^n = 



1, \co\ < co c , 
0, (jl> c < \a>\ < n. 




Figure P2.67-1 

2.68. Figure PI. 68-1 shows the input-output relationships of Systems A and B, while Fig- 
ure Pl.68-2 contains two possible cascade combinations of these systems. 



x A [n] 



System A 



+~ y A [n]=x A [-n] 



x B [n] 



System B 



•*- yfl[n]=*fl[n + 2] 



Figure P2.68-1 



Xl [n] 



System A 



System B 



■>- "iM 



*2t«] 



System B 



System A 



-*" w 2 [n] 



Figure P2.68-2 
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If xi[n] = X2[n] 7 will wi[n] and W2[n] necessarily be equal? If your answer is yes, clearly and 
concisely explain why and demonstrate with an example. If your answer is not necessarily, 
demonstrate with a counterexample. 

2.69. Consider the system in Figure P2.69-1, where the subsystems Si and S2 are LTI. 



1 
1 








1 
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Si 


yM 
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1 






G 


x[n] | 


Sr 




s 2 


7 






y^n] 











y[n] 



Figure P2.69-1 



(a) Is the overall system enclosed by the dashed box, with input x[n] and output y[n] equal 
to the product of y\[ri\ and y2[n], guaranteed to be an LTI system? If so, explain your 
reasoning. If not, provide a counterexample. 

(b) Suppose Si and Sz have frequency responses H\{e^) and Hi(e i0> ) that are known to 
be zero over certain regions. Let 



Hi(en = 



0, 



\co\ < 0.2jt, 



unspecified, 02tt < \co\ < 7t y 

H <e!<»\ - / Uns P ecified - l»l ^ °- 4jr ' 

2K } ~ \ 0, OAtt < \a>\ < it. 

Suppose also that the input x[ri\ is known to be bandlimited to 0.3jt, i.e., 

y( jo>\ — \ unspecified, \m\ < 0.3^, 
Ke ; ~\0, 03n < \co\ < n. 

Over what region of -n < a> < it is Y(e }co ), the DTFT of y[n], guaranteed to be zero? 
2.70. A commonly used numerical operation called the/*™* backward difference is defined as 

y[n] = V(*[n]) = x[n] - x[n - 1], 

where x[n] is the input and y[n] is the output of the first-backward-difference system. 

(a) Show that this system is linear and time invariant. 

(b) Find the impulse response of the system. 

(c) Find and sketch the frequency response (magnitude and phase). 

(d) Show that if 



x[n] = f[n]*g[n] } 



then 



V(*[/i]) = V(/M) * g[n] = f[n] * V(*[/i]), 

where * denotes discrete convolution. 
(e) Find the impulse response of a system that could be cascaded with the first-difference 
system to recover the input; i.e., find hi[n], where 

hi[n]*V(x[n])=x[n]. 

2.71. Let H{e^) denote the frequency response of an LTI system with impulse response h[n], 
where h[n] is, in general, complex. 
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(a) Using Eq. (2.109), show that H*(e~ jco ) is the frequency response of a system with 
impulse response h*[n], where * denotes complex conjugation. 

(b) Show that if h[n] is real, the frequency response is conjugate symmetric, i.e., H{e~ io) ) = 
H*(e* a ). 

2.72. Let X{e^) denote the Fourier transform of x[n]. Using the Fourier transform synthesis or 
analysis equations (Eqs. (2.133) and (2.134)), show that 

(a) the Fourier transform of x*[n] is X*(e~ }a> ), 

(b) the Fourier transform of x*[-n] is X*(e }C0 ). 

2.73. Show that for x[n] real, property 7 in Table 2.1 follows from property 1 and that properties 
8-11 follow from property 7. 

2.74. In Section 2.9, we stated a number of Fourier transform theorems without proof. Using the 
Fourier synthesis or analysis equations (Eqs. (2.133) and (2.134)), demonstrate the validity 
of Theorems 1-5 in Table 2.2. 

2.75. In Section 2.9.6, it was argued intuitively that 

y(0 = H(e ja) )X(e ia) ), (P2.75-1) 

when Y(e ia} ), H(e ;w ), and X(e }a> ) are, respectively, the Fourier transforms of the output 
v[n], impulse response h[n], and input x[n] of a linear time -invariant system; i.e., 

00 

y[n] = ^ x[k]h[n - k]. (P2.75-2) 

k=~ 00 

Verify Eq. (P2.75-1) by applying the Fourier transform to the convolution sum given in 
Eq. (P2.75-2). 

2.76. By applying the Fourier synthesis equation (Eq. (2.133)) to Eq. (2.172) and using Theorem 3 
in Table 2.2, demonstrate the validity of the modulation theorem (Theorem 7, Table 2.2). 

2.77. Let x[n] and y[n] denote complex sequences and X(e }0) ) and Y(ei a ) their respective Fourier 
transforms. 

(a) By using the convolution theorem (Theorem 6 in Table 2.2) and appropriate properties 
from Table 2.2, determine, in terms of x[n] and y[ri], the sequence whose Fourier 
transform is X{ei a )Y*(e> a ). 

(b) Using the result in Part (a), show that 

Y, *M/M = ^ / X(e>'»)Y*(e>'»)da>. (P2.77-1) 

Equation (P2.77-1) is a more general form of Parseval's theorem, as given in Sec- 
tion 2.9.5. 

(c) Using Eq. (P2.77-1), determine the numerical value of the sum 

Esin(^n/4) sin(;m/6) 
Inn Sizn 

«=-00 

2.78. Let x[n] and X(ei w ) represent a sequence and its Fourier transform, respectively. Deter- 
mine, in terms of X(e^), the transforms of v s [n], yd[n], and y e [n]. In each case, sketch 
Y(e^) for X(e> w ) as shown in Figure P2.78-1. 
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X(e*») 




Figure P2.78-1 



(a) Sampler: 



„l_/*M- n 
J ~\0, n 



y*[n] = 



even, 
odd. 



Note that y s [n] = \{x[n] + (-l) n x[n]} and -1 = e^. 



(b) Compressor: 

(c) Expander: 



y e [ 



y d [n] = x[2n]. 



,_(x[n/2l n 
J "\0, n 



even, 
odd. 



2.79. The two-frequency correlation function <!>*(#, a>) is often used in radar and sonar to evalu- 
ate the frequency and travel-time resolution of a signal. For discrete-time signals, we define 



Q x (N f a>) = ^ x l n + #]**[» - N \ e 



— ]o>n 



(a) Show that 

(b) If 



Q x (-N t -co) = <t>:(N,a>). 



x[n] = A^uty], < a < 1, 



find <t> x (N, (o). (Assume that N>0.) 
(c) The function <!>*(#, co) has a frequency domain dual. Show that 

J — 7T 

2.80. Let x[n] and >[n] be stationary, uncorrelated random signals. Show that if 

w[n]=x[n] + y[n], 

then 

m* =m x +m y and a 2 = a 2 + a 2 . 

24ft. Let e[n] denote a white-noise sequence, and let s[n] denote a sequence that is uncorrelated 
with e[n]. Show that the sequence 

y[n] = s[n]e[n] 

is white, i.e,, that 

E{y[n]y[n + m]} = A8[m], 

where A is a constant. 
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2.82. Consider a random signal x[n] = s[n] + e[n], where both s[n] and e[n] are indepen- 
dent zero-mean stationary random signals with autocorrelation functions S s[w] and 4> ee \rri\ 
respectively. 

(a) Determine expressions for 4> xx [m] and <t> xx (e^ a) ). 

(b) Determine expressions for 4> xe [m] and <t> xe (e^). 

(c) Determine expressions for 0* s [m] and <P xs (e^ a '). 

2.83. Consider an LTI system with impulse response h[n] = a n u[n] with \a\ < 1. 

(a) Compute the deterministic autocorrelation function <£/,/, [ra] for this impulse response. 

(b) Determine the energy density function \H(e^)\ 2 for the system. 

(c) Use Parseval's theorem to evaluate the integral 



jl r 



H(e i<1} )\ 2 dco 



for the system. 

2.84. The input to the first-backward-difference system (Example 2.10) is a zero-mean white- 
noise signal whose autocorrelation function is 4> xx [m] = a 2 8[m]. 

(a) Determine and plot the autocorrelation function and the power spectrum of the cor- 
responding output of the system. 

(b) What is the average power of the output of the system? 

(c) What does this problem tell you about the first backward difference of a noisy signal? 

2.85. Let x[n] be a real, stationary, white-noise process, with zero mean and variance cr 2 . Let y[n] 
be the corresponding output when x[n] is the input to a linear time-invariant system with 
impulse response h[n]. Show that 

(a) E{x[n]y[n]) = h[0]cr 2 , 

2.86. Let x[n] be a real stationary white-noise sequence, with zero mean and variance or 2 . Let 
x[n] be the input to the cascade of two causal linear time-invariant discrete-time systems, 
as shown in Figure PI, 86-1. 



x[n] 



M«] 



y[n] 



h 2 [n] 



"M Figure P2.86-1 



(a) Isor^^Ew^W? 

(b) Isa^^JXo^]? 

(c) Let h\[ri\ — a n u[n] and h 2 [n] = Wu[ri\. Determine the impulse response of the overall 
system in Figure Pl.86-1, and, from this, determine a 2 . Are your answers to parts (b) 
and (c) consistent? 

2.87. Sometimes we are interested in the statistical behavior of a linear time-invariant system 
when the input is a suddenly applied random signal. Such a situation is depicted in Fig- 
ure Pl.87-1. 



^fc 



x[n] 



w[n] 



h[n] 



y[n] 



(switch closed at n = 0) Figure P2.87-1 

Let x[n] be a stationary white-noise process. The input to the system, w[n], given by 

r .. ( x[n], n>0, 
10, n < 0, 

is a nonstationary process, as is the output y[n\. 
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(a) Derive an expression for the mean of the output in terms of the mean of the input. 

(b) Derive an expression for the autocorrelation sequence 4> yy [n\ , 7*2] of the output. 

(c) Show that, for large n, the formulas derived in parts (a) and (b) approach the results 
for stationary inputs. 

(d) Assume that h[n] = <z n u[n]. Find the mean and mean-square values of the output in 
terms of the mean and mean-square values of the input. Sketch these parameters as a 
function of n. 

2.88. Let x[n] and y[n] respectively denote the input and output of a system. The input-output 
relation of a system sometimes used for the purpose of noise reduction in images is given 
by 



y[n] = ^M(x[n] - m x [n]) + m x [n], 



where 



k=n-l 

1 n+1 

m x[n] = 3 X^ *[*'' 



n+l 



fc=n-l 



■*-{?' 



otherwise, 



and a}, is a known constant proportional to the noise power. 

(a) Is the system linear? 

(b) Is the system shift invariant? 

(c) Is the system stable? 

(d) Is the system causal? 

(e) For a fixed x[n], determine y[n] when o* is very large (large noise power) and when 
a* is very small (small noise power). Does y[n] make sense for these extreme cases? 

2.89. Consider a random process x[ri\ that is the response of the linear time-invariant system 
shown in Figure P2.89-1. In the figure, w[n] represents a real zero-mean stationary white- 
noise process with £{w 2 [n]} = <r£. 



w[n] 



H(ei a ) = 



1 



l-0.5e> 



X W* Figure P2.89-1 



(a) Express £{jc 2 [/i]} in terms of <p xx [n] or <^ xx (e^). 

(b) Determine <t> xx (e^ w ), the power density spectrum of x[n], 

(c) Determine (p xx [n], the correlation function of x[n] t 

2.90. Consider a linear time-invariant system whose impulse response is real and is given by h[n]. 
Suppose the responses of the system to the two inputs x[n] and v[n] are, respectively, y[n] 
and z[n], as shown in Figure P2.90-1. 




h[n) 



Figure P2.90-1 
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The inputs x[n] and v [n] in the figure represent real zero-mean stationary random processes 
with autocorrelation functions fe[n] and ut ,[n], cross-correlation function xu [/i], power 
spectra ^ xx (e ja> ) and 4> wi) (e ;ft 0, and cross power spectrum ^ xv (e^). 

(a) Given <f> xx [n], <p vv [n], 4> xv [nl <t> xx (e jco ), <J\ w (e^), and <&«(«'"). determine <t> yz (eJ°>), the 
cross power spectrum of y[n] and z[w], where <D >z (e^) is defined by 

4> yz [n] ^ <M«>"), 

with <p yz [n] = £{)>[fc|z[fc — n]}. 

(b) Is the cross power spectrum Qxvie*' ) always nonnegative; i.e., is & X v(e* a ) > for all 
<y? Justify your answer. 

2.91. Consider the LTI system shown in Figure P2.91-1. The input to this system, e[n] , is a station- 
ary zero-mean white-noise signal with average power a}. The first system is a backward- 
difference system as defined in Eq. 2.45 with f[n] = e[n] — e[n — 1], The second system is 
an ideal lowpass filter with frequency response 



H 2 (en = 



1, \co\ < co c , 

0, (O c < \0)\ < 71. 



e[n] 



LTI system 

#1 



/[»] 



LTI system 

#2 



*M Figure P2.91-1 



(a) Determine an expression for <J>//(e ;c "), the power spectrum of /[«], and plot this ex- 
pression for —In < (o <2n. 

(b) Determine an expression for <£//[m], the autocorrelation function of /[«]. 

(c) Determine an expression for ^ gg (e^ to ) t the power spectrum of g[n], and plot this 
expression for — 2tt < co <2tz. 

(d) Determine an expression for a|, the average power of the output. 
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The z-transform 



3.0 INTRODUCTION 

We have seen that the Fourier transform plays a key role in representing and analyzing 
discrete-time signals and systems. In this chapter, we develop the z-transform repre- 
sentation of a sequence and study how the properties of a sequence are related to the 
properties of its z-transform. The z-transform for discrete-time signals is the counter- 
part of the Laplace transform for continuous-time signals, and they each have a similar 
relationship to the corresponding Fourier transform. One motivation for introducing 
this generalization is that the Fourier transform does not converge for all sequences and 
it is useful to have a generalization of the Fourier transform that encompasses a broader 
class of signals. A second advantage is that in analytical problems the z-transform no- 
tation is often more convenient than the Fourier transform notation. 



3.1 z-TRANSFORM 

The Fourier transform of a sequence x[n] was defined in Chapter 2 as 

oo 

X(e j( °) = Y^ x[n]e- ia,n . (3.1) 

n=— oo 

The z-transform of a sequence x[n] is denned as 

oo 
n=—oo 
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This equation is, in general, an infinite sum or infinite power series, with z being a com- 
plex variable. Sometimes it is useful to consider Eq. (3.2) as an operator that transforms 
a sequence into a function, and we will refer to the z-transform operator Z{], defined as 

00 

Z[x[n]} = Y, x Wz~ n = *(*)• ( 3 - 3 ) 

n=-oc 

With this interpretation, the z-transform operator is seen to transform the sequence x[n] 
into the function X(z), where z is a continuous complex variable. The correspondence 
between a sequence and its z-transform is indicated by the notation 

x[n] ^ X(z). (3.4) 

The z-transform, as we have defined it in Eq. (3.2), is often referred to as the 
two-sided or bilateral z-transform, in contrast to the one-sided or unilateral z-transform, 
which is defined as 

00 

*<*) = 5>[n]z-". (3.5) 

Clearly, the bilateral and unilateral transforms are equivalent only if x[n] = for n < 0. 
In this book, we focus on the bilateral transform exclusively. 

It is evident from a comparison of Eqs. (3.1) and (3.2) that there is a close rela- 
tionship between the Fourier transform and the z-transform. In particular, if we replace 
the complex variable z in Eq. (3.2) with the complex variable e ;a \ then the z-transform 
reduces to the Fourier transform. This is one motivation for the notation X(e^ to ) for the 
Fourier transform; when it exists, the Fourier transform is simply X(z) with z = e ]0} . This 
corresponds to restricting z to have unity magnitude; i.e., for \z\ = 1, the z-transform 
corresponds to the Fourier transform. More generally, we can express the complex 
variable z in polar form as 

z = re jw . 

With z expressed in this form, Eq. (3.2) becomes 

oo 

X(re }w ) = Y, x[n\(re jo) )-\ 

n=—oo 

or 

oo 

X(re i<0 ) = Y (x[n]r- n )e- i6,n . (3.6) 

n—— oo 

Equation (3.6) can be interpreted as the Fourier transform of the product of the original 
sequence x[n] and the exponential sequence r~ n . Obviously, for r = 1, Eq. (3.6) reduces 
to the Fourier transform of x[n]. 

Since the z-transform is a function of a complex variable, it is convenient to de- 
scribe and interpret it using the complex z-plane. In the z-plane, the contour corre- 
sponding to \z\ = 1 is a circle of unit radius, as illustrated in Figure 3.1. This contour is 
referred to as the unit circle. The z-transform evaluated on the unit circle corresponds 
to the Fourier transform. Note that co is the angle between the vector to a point z on the 
unit circle and the real axis of the complex z-plane. If we evaluate X(z) at points on the 
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Unit circle 


Sm 

z- 

/V 


z-plane 






)\ the 



Figure 3.1 The unit circle in the 
complex z-plane. 



unit circle in the z-plane beginning at z — 1 (i.e., co = 0) through z = j (i.e., co = jt/2) 
to z = —1 (i.e., w = i), we obtain the Fourier transform for < co < n. Continuing 
around the unit circle would correspond to examining the Fourier transform from co = n 
to co = 2tt or, equivalently, from co = -n to co = 0. In Chapter 2, the Fourier trans- 
form was displayed on a linear frequency axis. Interpreting the Fourier transform as the 
z-transform on the unit circle in the z-plane corresponds conceptually to wrapping the 
linear frequency axis around the unit circle with co = at z = 1 and co = tt at z = — 1. 
With this interpretation, the inherent periodicity in frequency of the Fourier transform 
is captured naturally, since a change of angle of In radians in the z-plane corresponds 
to traversing the unit circle once and returning to exactly the same point. 

As we discussed in Chapter 2, the power series representing the Fourier transform 
does not converge for all sequences; i.e., the infinite sum may not always be finite. 
Similarly, the z-transform does not converge for all sequences or for all values of z. 
For any given sequence, the set of values of z for which the z-transform converges is 
called the region of convergence, which we abbreviate ROC. As we stated in Sec. 2.7, if 
the sequence is absolutely summable, the Fourier transform converges to a continuous 
function of co. Applying this criterion to Eq. (3.6) leads to the condition 



Yl \ x W r ' 



< oo 



(3.7) 



for convergence of the z-transform. It should be clear from Eq. (3.7) that, because of 
the multiplication of the sequence by the real exponential r~ n , it is possible for the 
z-transform to converge even if the Fourier transform does not. For example, the se- 
quence x[n] = u[n] is not absolutely summable, and therefore, the Fourier transform 
does not converge absolutely. However, r~ n u[n] is absolutely summable if r > 1. This 
means that the z-transform for the unit step exists with a region of convergence \z\ > 1. 
Convergence of the power series of Eq. (3.2) depends only on |zi, since |X(z)| < oo 
if 



J2 i*mi 



< oo, 



(3.8) 



i. e., the region of convergence of the power series in Eq. (3.2) consists of all values of z 
such that the inequality in Eq. (3.8) holds. Thus, if some value of z, say, z = Z\, is in the 
ROC, then all values of z on the circle defined by \z\ = \z\ \ will also be in the ROC. As 
one consequence of this, the region of convergence will consist of a ring in the z-plane 
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Figure 3.2 The region of convergence 
(ROC) as a ring in the z-plane. For 
specific cases, the inner boundary can 
extend inward to the origin, and the ROC 
becomes a disc. For other cases, the 
outer boundary can extend outward to 
infinity. 

centered about the origin. Its outer boundary will be a circle (or the ROC may extend 
outward to infinity), and its inner boundary will be a circle (or it may extend inward to 
include the origin). This is illustrated in Figure 3.2. If the ROC includes the unit circle, 
this of course implies convergence of the z-transform for \z\ = 1, or equivalently, the 
Fourier transform of the sequence converges. Conversely, if the ROC does not include 
the unit circle, the Fourier transform does not converge absolutely. 

A power series of the form of Eq. (3.2) is a Laurent series. Therefore, a number of 
elegant and powerful theorems from the theory of functions of a complex variable can be 
employed in the study of the z-transform. (See, for example, Churchill and Brown, 1990.) 
A Laurent series, and therefore the z-transform, represents an analytic function at every 
point inside the region of convergence; hence, the z-transform and all its derivatives 
must be continuous functions of z within the region of convergence. This implies that if 
the region of convergence includes the unit circle, then the Fourier transform and all its 
derivatives with respect to co must be continuous functions of co. Also, from the discussion 
in Section 2.7, the sequence must be absolutely summable, i.e., a stable sequence. 

Uniform convergence of the z-transform requires absolute summability of the 
exponentially weighted sequence, as stated in Eq. (3.7). Neither of the sequences 

sin oj c n 

x\\n\ = , — oo < n < oo, 

nn 
and 

jc 2 [«] = cos coon, — oo < n < oo, 

is absolutely summable. Furthermore, neither of these sequences multiplied by r~ n 
would be absolutely summable for any value of r. Thus, these sequences do not have 
a z-transform that converges absolutely for any z- However, we showed in Section 2.7 
that even though sequences such as jci[«] are not absolutely summable, they do have 
finite energy, and the Fourier transform converges in the mean-square sense to a discon- 
Jiifuous periodic function. Similarly, the sequence x^\p\ is neither absolutely nor square 
summable, but a useful Fourier transform for xi [n] can be defined using impulses. In both 
cases the Fourier transforms are not continuous, infinitely differentiable functions, so 
they cannot result from evaluating a z-transform on the unit circle. Thus, in such cases it 
is not strictly correct to think of the Fourier transform as being the z-transform evaluated 
on the unit circle, although we nevertheless use the notation X(e^) that implies this. 

The z-transform is most useful when the infinite sum can be expressed in closed 
form, i.e., when it can be "summed" and expressed as a simple mathematical formula. 
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Among the most important and useful z-transforms are those for which X(z) is a rational 
function inside the region of convergence, i.e., 

P(z) 

x(z) = m- (3 - 9) 

where P(z) and Q (z) are polynomials in z. The values of z for which X(z) = are called 
the zeros of X(z), and the values of z for which X(z) is infinite are referred to as the 
poles of X(z). The poles of X(z) for finite values of z are the roots of the denominator 
polynomial. In addition, poles may occur at z = or z = oo. For rational z-transforms, 
a number of important relationships exist between the locations of poles of X(z) and 
the region of convergence of the z-transform. We discuss these more specifically in 
Section 3.2. First, however, we illustrate the z-transform with several examples. 

Example 3.1 Right-Sided Exponential Sequence 

Consider the signal x[n] = a n u[n]. Because it is nonzero only for n > 0, this is an 
example of a right-sided sequence. From Eq. (3.2), 

oo oo 

X{z)= J2 =a"u[n]z- n = J2( a *- 1 )"- 

n=-oo n=0 

For convergence of X(z), we require that 

oo 

Y^\az~ l \ n < oo. 

n=0 

Thus, the region of convergence is the range of values of z for which \az~ l \ < 1 or, 
equivalently, \z\ > \a\. Inside the region of convergence, the infinite series converges to 

00 1 

X(z) = J2(az- 1 r = ' =3- = —. \z\>\a\. (3.10) 

*— ' 1 — az 1 z — a 

Here we have used the familiar formula for the sum of terms of a geometric 
series. The z-transform has a region of convergence for any finite value of \a\. The 
Fourier transform of x[n], on the other hand, converges only if \a\ < 1. For a = l,x[n] 
is the unit step sequence with z-transform 

X(z) = —^, |z|>l. (3.11) 



l-z 



-l ' 



In Example 3.1, the infinite sum is equal to a rational function of z inside the 
region of convergence; for most purposes, this rational function is a much more con- 
venient representation than the infinite sum. We will see that any sequence that can 
be represented as a sum of exponentials can equivalently be represented by a rational 
z-transform. Such a z-transform is determined to within a constant multiplier by its 
zeros and its poles. For this example, there is one zero, at z = 0, and one pole, at z = a. 
The pole-zero plot and the region of convergence for Example 3.1 are shown in Fig- 
ure 3.3 where a "o" denotes the zero and an "x" the pole. For \a\ > 1, the ROC does 
not include the unit circle, consistent with the fact that, for these values of a, the Fourier 
transform of the exponentially growing sequence a n u[n] does not converge. 
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z-plane 
Unit circle 



Figure 3.3 Pole-zero plot and region 
of convergence for Example 3.1 . 



Example 3.2 Left-Sided Exponential Sequence 

Now let x[n] — —a"u[—n — 1]. Since the sequence is nonzero only for n < — 1, this is 
a left-sided sequence. Then 



X{z) = - J2 a n u[-n - l]z~ n = - ^ a n z~ n 

n=~ oo n=— oc 

00 oc 

= -X>~ v = i -X>~ lz ) n - 

n=\ n=0 

If \a~ l z\ < 1 or, equivalently, |z| < |a|, the sum in Eq. (3.12) converges, and 

1 1 z 



(3.12) 



X(z) = 1 - 



1 — a~ l z 1 — az~ l 



z — a 



\z\ < a 



(3.13) 
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Figure 3.4 Pole-zero plot and region of convergence for Example 3.2. 

The pole-zero plot and region of convergence for this example are shown in Figure 3.4. 
Note that for \a\ < 1, the sequence —a n u[—n — 1] grows exponentially as n -► -oo, 
and thus, the Fourier transform does not exist. 
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Comparing Eqs. (3.10) and (3.13) and Figures 3.3 and 3.4, we see that the sequences 
and, therefore, the infinite sums are different; however, the algebraic expressions for 
X(z) and the corresponding pole-zero plots are identical in Examples 3.1 and 3.2. The 
z-transforms differ only in the region of convergence. This emphasizes the need for spec- 
ifying both the algebraic expression and the region of convergence for the z-transform 
of a given sequence. Also, in both examples, the sequences were exponentials and the 
resulting z-transforms were rational. In fact, as is further suggested by the next exam- 
ple, X(z) will be rational whenever x[n] is a linear combination of real or complex 
exponentials. 

Example 3.3 Sum of Two Exponential Sequences 

Consider a signal that is the sum of two real exponentials: 

*M = (i)%M + (-i)%M. (3.14) 



3rn z-plane 




(a) 



(b) 



$m z-plane 




(c) 

Figure 3.5 Pole-zero plot and region of convergence tor the individual terms 
and the sum ot terms in Examples 3.3 and 3.4. (a) 1/(1 - Jz _1 ), |z| > \. 
(b) 1/(1 + Jz- 1 ), \z\ > I (c) 1/(1 - Jz- 1 ) + 1/(1 + \z~\ \z\ > I 
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The z-transform is then 

*« = E ( (5)" "H + (-!)" «MR" 

OC OO 

= E (j)"»W^"+ E H)""M*~" (3.15) 



n= — 00 

00 



= E(KT + E(-KT 



n=0 n=0 



1 1 _ 2(l-i z -') 

-r 



!_i z -i i + i r i (i-Jr')(l + ir') 



(3.16) 



For convergence of X(z), both sums in Eq. (3.15) must converge, which requires that 
both l^z -1 ! < 1 and |(-^) z _1 1 < 1 or, equivalently, \z\ > \ and \z\ > \. Thus, the 
region of convergence is the region of overlap, \z\ > |. The pole-zero plot and ROC 
for the z-transform of each of the individual terms and for the combined signal are 
shown in Figure 3.5. 

In each of the preceding examples, we started with the definition of the sequence 
and manipulated each of the infinite sums into a form whose sum could be recog- 
nized. When the sequence is recognized as a sum of exponential sequences of the form 
of Examples 3.1 and 3.2, the z-transform can be obtained much more simply using 
the fact that the z-transform operator is linear. Specifically, from the definition of the 
z-transform, Eq. (3.2), if x[n] is the sum of two terms, then X{z) will be the sum of the 
corresponding z-transforms of the individual terms. The ROC will be the intersection 
of the individual regions of convergence, i.e., the values of z for which both individual 
sums converge. We have already demonstrated this fact in obtaining Eq. (3.15) in Ex- 
ample 3.3. Example 3.4 shows how the z-transform in Example 3.3 can be obtained in 
a much more straightforward manner. 

Example 3.4 Sum of Two Exponentials (Again) 

A^ain, let x[ri\ be given by Eq. (3.14). Then using the general result of Example 3.1 with 
a —\\ and a = — |, the z-transforms of the two individual terms are easily seen to be 

(!)"«[«] ^-^—, k|>i, (3.17) 



(-!)%[«] *±+ —r-rr, \z\>l (3.18) 

J- *T" T <* 



3 



and, consequently, 



(i)"u[«]+(-i)"«W^— T^T + 7- — • W >!• < 319 > 

as we had determined in Example 3.3. The pole-zero plot and ROC for the z-transform 
of each of the individual terms and for the combined signal are shown in Figure 3.5. 
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All the major points of Examples 3.1-3.4 are summarized in Example 3.5. 
Example 3.5 Two-Sided Exponential Sequence 

Consider the sequence 

x[n]= (-\)"u[n]- (±)"k[-/i-1]. (3.20) 

Note that this sequence grows exponentially as n — > — oo. Using the general result of 
Example 3.1 with a = — |, we obtain 

and using the result of Example 3.2 with a — \ yields 

-(•y^-n-i] *i* _ r 

i 2 z 
Thus, by the linearity of the z-transform, 

1 1 



z > k. 



\z\ < * 



X(z) = 



1 + i*-' 



+ 



4 < zl, |z < 4, 



1 - iz" 1 ' 

2(1-^"') 2z(;-±) 



(3.21) 



( 1+ - z -.) (!_.,-■) ( Z+ I)( Z -|) 



In this case, the ROC is the annular region 1 < \z\ < \. Note that the rational function 
in this example is identical to the rational function in Examples 3.3 and 3.4, but the 
ROC is different in the three cases. The pole-zero plot and the ROC for this example 
are shown in Figure 3.6. 
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Figure 3.6 Pole-zero plot and region of convergence for Example 3.5. 

Note that the ROC does not contain the unit circle, so the sequence in Eq. (3.20) does 
not have a Fourier transform. 



In each of the preceding examples, we expressed the z-transform both as a ratio 
of polynomials in z and as a ratio of polynomials in z~ l . From the form of the definition 
of the z-transform as given in Eq. (3.2), we see that, for sequences that are zero for 
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n < 0, X(z) involves only negative powers of z. Thus, for this class of signals, it is 
particularly convenient for X(z) to be expressed in terms of polynomials in z~ l rather 
than z\ however, even when x\n\ is nonzero for n < 0, X(z) can still be expressed in 
terms of factors of the form (1 — az' 1 ). It should be remembered that such a factor 
introduces both a pole and a zero, as illustrated by the algebraic expressions in the 
preceding examples. 

From these examples, it is easily seen that infinitely long exponential sequences 
have z-transforms that can be expressed as rational functions of either z or z~ l . The 
case where the sequence has finite length also has a rather simple form. If the sequence 
is nonzero only in the interval N\ <n < N2, the z-transform 

X(z) = Y, x[n\ Z - n (3.22) 

has no problems of convergence, as long as each of the terms |jc[az]z""| is finite. In 
general, it may not be possible to express the sum of a finite set of terms in a closed 
form, but in such cases it may be unnecessary. For example, it is easily seen that if 
x[n] = 8[n] + 8[n — 5], then X(z) = 1 + z~ 5 , which is finite for \z\ > 0. An example 
of a case where a finite number of terms can be summed to produce a more compact 
representation of the z-transform is given in Example 3.6. 

Example 3.6 Finite-Length Sequence 

Consider the signal 

x \ i_ /«". 0<n<N-l, 
\ 0, otherwise. 

Then 

x(z) = Ys" n z~ n =Y;( az ~ 1)n 

n=0 n=Q (3.23) 

_ l-^- 1 )* ^ 1 z N -a N 
~ 1 -az~ l _ Z N ~ l Z-a ' 

where we have used the ^general formula in Eq. (2.56) to sum the finite series. The 
ROC is determined by the Set of values of z for which 



N-l 

E 

n=0 



\az~ l \ n < 00. 



Since there are only a finite number of nonzero terms, the sum will be finite as long 
as az~ l is finite, which in turn requires only that \a\ < 00 and z ^ 0. Thus, assuming 
that \a\ is finite, the ROC includes the entire z-plane, with the exception of the origin 
(z — 0). The pole-zero plot for this example, with N = 16 and a real and between zero 
and unity, is shown in Figure 3.7. Specifically, the JV roots of the numerator polynomial 
are at 

Zk = ae^ 2nk/N) , k = 0, 1, . . . , N - 1. (3.24) 

(Note that these values satisfy the equation z N — a N , and when a = 1, these complex 
values are the Mh roots of unity.) The zero at k = cancels the pole at z = a. 
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15th-order pole 



z-plane 
Unit circle 




Figure 3.7 Pole-zero plot for Example 3.6 with N = 16 and a real such that 
< a < 1. The region of convergence in this example consists of all values of z 
except z = 0. 

Consequently, there are no poles other than at the origin. The remaining zeros are al 

z k = ae* 2nkIN) , k=l N-h (325] 

TABLE 3.1 SOME COMMON z-TRANSFORM PAIRS 



Sequence 



Transform 



ROC 



1. S[n] 

2. u[n] 

3. -u[-n-l) 

4. 8[n-m] 

5. a n u[n] 

6. -a n u[-n-l] 

7. na n u[n] 

8. -na n u[-n-l] 

9. [coswo"]«[«] 

10. [sin woiMn] 

11. [r n cosa)on]u[n] 

12. [r n sin(oon]u[n] 



13. 



a n , <«< N-l, 
0, otherwise 



-7-1 



- 7-1 



~az 



-l 



— n 7 _ 1 



az~ 



az 



-1 



l-az' 1 ) 1 

az~ l 



\-az~ 1 ) 2 

1 — [coso>o]z -1 



[2cosa>o]z _1 + z~ 2 
[sin o>q]z" 1 



- [2cos^o]z -1 + z~ 2 
1 — [r coso»o]z -1 



[2r co$cl>o]z~ 1 + r 2 z' 2 
[rsin^o]z -1 



-1 j_r2»-2 



- [2r cos(Do]z~ l + r 2 z 

~a N Z- N 
1 - az~ l 



Allz 

\z\>l 

\z\ <1 

All z except (if m > 0) 

or 00 (if m < 0) 

1*1 > \a\ 

\z\ < \a\ 
\z\ > \a\ 
Izl < l«l 

1*1 >i 
\z[>l 
\z\>r 
\z\>r 
Ul>0 
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The transform pairs corresponding to some of the preceding examples, as well as a 
number of other commonly encountered z-transform pairs, are summarized in Table 3.1 . 
We will see that these basic transform pairs are very useful in finding z-transforms given 
a sequence or, conversely, in finding the sequence corresponding to a given z-transform. 

3.2 PROPERTIES OF THE REGION OF CONVERGENCE 
FOR THE z-TRANSFORM 

The examples of the previous section suggest that the properties of the region of con- 
vergence depend on the nature of the signal. These properties are summarized next, 
followed by some discussion and intuitive justification. We assume specifically that the 
algebraic expression for the z-transform is a rational function and that x[n] has finite 
amplitude, except possibly at n = oo or n = — oo. 

property 1 : The ROC is a ring or disk in the z-plane centered at the origin; i.e., 

< r R < \z\ < r L < oo. 

property 2: The Fourier transform of x[n] converges absolutely if and only if 
the ROC of the z-transform of x[n] includes the unit circle. 

property 3: The ROC cannot contain any poles. 

property 4: If x[n] is a. finite- duration sequence, i.e., a sequence that is zero except 
in a finite interval -oo < N\ < n < N 2 < oo, then the ROC is the entire z-plane, 
except possibly z = or z = oo. 

property 5: If x[n] is a right-sided sequence, i.e., a sequence that is zero for 
n < Ni < oo, the ROC extends outward from the outermost (i.e., largest 
magnitude) finite pole in X(z) to (and possibly including) z = oo. 

property 6: If x[n] is a left-sided sequence, i.e., a sequence that is zero for n > 
N 2 > — oo, the ROC extends inward from the innermost (smallest magnitude) 
nonzero pole in X(z) to (and possibly including) z = 0. 

property 7: A two-sided sequence is an infinite-duration sequence that is neither 
right sided nor left sided. If* [«]ls"a two-sided sequence, the ROC will consist 
of a ring in the z-plane, bounded on the interior and exterior by a pole and, 
consistent with property 3, not containing any poles. 

property 8: The ROC must be a connected region. 

As discussed in Section 3.1, property 1 results from the fact that convergence of 
Eq. (3.2) for a given x[n] is dependent only on |z|, and property 2 is a consequence of 
the fact that Eq. (3.2) reduces to the Fourier transform when |z| = 1. Property 3 follows 
from the recognition that X(z) is infinite at a pole and therefore, by definition, does not 
converge. 

Properties 4 through 7 can all be developed more or less directly from the inter- 
pretation of the z-transform as the Fourier transform of the original sequence, modified 
by an exponential weighting. Let us first consider property 4. Figure 3.8 shows a finite- 
duration sequence and the exponential sequence r~ n for 1 < r (a decaying exponential) 
and for < r < 1 (a growing exponential). Convergence of the z-transform is implied 
by absolute summability of the sequence x[«]|z| _ " or, equivalently, x[n]r~ n . It should 
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• — •- 



x[n] 



U 



-9 • •- 



M 



(a) 



N, 



r " for r > 1 



(b) 



r n for < r < 1 



(c) 



Figure 3.8 Finite-length sequence and 
weighting sequences implicit in 
convergence of the z-transform. 

(a) The finite-length sequence x[ri\. 

(b) Weighting sequence r~ n for 1 < r. 

(c) Weighting sequence r~ n for 
0<r < 1. 



be evident from Figure 3.8 that, since x[n] has only a finite number of nonzero values, as 
long as each of these values is finite, x[n] will be absolutely summable. Furthermore, this 
will not be affected by the exponential weighting if the weighting sequence has finite 
amplitude in the interval where x[n] is nonzero, i.e., N\ < n < N2. Therefore, for a 
finite-duration sequence, x[rc]r~" will be absolutely summable for < r < 00. The only 
possible complication arises for r = or for r = 00. If x[n] is nonzero for any positive 
values of n (i.e., if N2 > 0), and if r, or, equivalently, \z\, is zero, then x[n]r~ n will be 
infinite for < n < N2. Correspondingly, if x[n] is nonzero for any negative values of 
n (i.e., if N\ < 0), then x[n]r~ n will be infinite f or N\ < n < if r, or, equivalently, |zj, 
is infinite. 

Property 5 can be interpreted in a somewhat similar manner. Figure 3.9 illustrates 
a right-sided sequence and the exponential sequence r~ n for two different values of r. 
A right-sided sequence is zero prior to some value of n, say, N\ . If the circle \z\ = /"o is in 
the ROC, then x[n]rQ n is absolutely summable, or equivalently, the Fourier transform of 
x[n]r^ n converges. Since x[n] is right sided, the sequence x[n]r^ n will also be absolutely 
summable if rf " decays faster than r$ n . Specifically, as illustrated in Figure 3.9, this more 
rapid exponential decay will further attenuate sequence values for positive values of n 
and cannot cause sequence values for negative values of n to become unbounded, since 
jc[n]z~" = for n < N\. Based on this property, we can conclude that, for a right-sided 
sequence, the ROC extends outward from some circle in the z-plane, concentric with the 
origin. This circle, in fact, is at the outermost pole in X(z). To see this, assume that the 
poles occur at z = d\, . . . , d^, with d\ having the smallest magnitude, i.e., corresponding 
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Figure 3.9 Right-sided sequence and 
weighting sequences implicit in 
convergence of the z-transform. (a) The 
right-sided sequence x[n]. 

(b) Weighting sequence r -/7 for 1 < r . 

(c) Weighting sequence r j - " for ^ > r . 



to the innermost pole, and d^ having the largest magnitude, i.e., corresponding to the 
outermost pole. To simplify the argument, we will assume that all the poles are distinct, 
although the argument can be easily generalize£Tfor multiple-order poles. As we will 
see in Section 3.3, for N\ < n, x[n] will consist of a sum of exponentials of the form 



N 



jc[n] = ^Ajk(4) w , n> Ny 



(3.26) 



*=i 



The least rapidly increasing of these exponentials, as n increases, is the one correspond- 
ing to the innermost pole, i.e., d\ , and the most slowly decaying (or most rapidly growing) 
is the one corresponding to the outermost pole, i.e., d^. Now let us consider x[n] with 
the exponential weighting r~" applied, i.e., 



N 



x[n\r- n = r- n Y,Md k )\ n>N u 

k=\ 

N 

= ^2A k (d k r- 1 ) n , n>N v 



(3.27) 
(3.28) 



*=i 
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Absolute summability of x[n]r~" requires that each exponential in Eq. (3.28) be abso- 
lutely summable; i.e., 

OQ 

5^|*r- 1 r<oo, *=1,...,N, (3.29) 

or equivalently, 

|r|>kfe|, *=1,...,M (3.30) 

Since the outermost pole, d^, is the one with the largest absolute value, 

\r\ > |<*vl; (3.31) 

i.e., the ROC is outside the outermost pole, extending to infinity. If N\ < 0, the ROC 
will not include |z| = oo, since r~ n is infinite for r infinite and n negative. 

As suggested by the preceding discussion, it is possible to be very precise about 
property 5 (as well as the associated properties 6 and 7). The essence of the argument, 
however, is that for a sum of right-sided exponential sequences with an exponential 
weighting applied, the exponential weighting must be restricted so that all of the expo- 
nentially weighted terms decay with increasing n. 

For property 6, which is concerned with left-sided sequences, an exactly parallel 
argument can be carried out. Here, however, x[n] will consist of a sum of exponentials 
of the same form as Eq. (3,28), but for n < N 2 \ i.e., 

N 

x[n] = Y,Mdk)"< n<N 2 , (3.32) 

k=\ 

or, with exponential weighting, 

N 

x[n]r~ n = Yl Md k r~ l ) n , n 5 N 2 . (3.33) 

*=i 

Since x[n] now extends to —00 along the negative n-axis, r must be restricted so that for 
each dk, the exponential sequence (d k r~ l ) n decays to zero as n decreases toward —00. 
Equivalently, 

\r\ < \d k \, *=1,... (J /V, 
or, since d\ has the smallest magnitude, 

Ir|<l4|; (3.34) 

i.e., the ROC is inside the innermost pole. If the left-sided sequence has nonzero values 
for positive values of n, then the ROC will not include the origin, z = 0. 

For right-sided sequences, the ROC is dictated by the exponential weighting re- 
quired to have all exponential terms decay to zero for increasing n; for left-sided se- 
quences, the exponential weighting must be such that all exponential terms decay to 
zero for decreasing n. For two-sided sequences, the exponential weighting needs to be 
balanced, since if it decays too fast for increasing n, it may grow too quickly for de- 
creasing n and vice versa. More specifically, for two-sided sequences, some of the poles 
contribute only for n > and the rest only for n < 0. The region of convergence is 
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Figure 3.10 Examples of four z- transforms with the same pole-zero locations, 
illustrating the different possibilities for the region of convergence. Each ROC 
corresponds to a different sequence: (b) to a right-sided sequence, (c) to a left- 
sided sequence, (d) to a two-sided sequence, and (e) to a two-sided sequence. 
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bounded on the inside by the pole with the largest magnitude that contributes for n > 
and on the outside by the pole with the smallest magnitude that contributes for n < 0. 
Property 8 is somewhat more difficult to develop formally, but, at least intuitively, 
it is strongly suggested by our discussion of properties 4 through 7. Any infinite two- 
sided sequence can be represented as a sum of a right-sided part (say, for n > 0) and a 
left-sided part that includes everything not included in the right-sided part. The right- 
sided part will have an ROC given by Eq. (3.31), while the ROC of the left-sided part 
will be given by Eq. (3.34). The ROC of the entire two-sided sequence must be the 
intersection of these two regions. Thus, if such an intersection exists, it will always be a 
simply connected annular region of the form 

fR < \z\ <r L . 

There is a possibility of no overlap between the regions of convergence of the right- 
and left-sided parts; i.e., r L < r R . An example is the sequence x[n] = Q) u[n] — 
(—5) u[—n — 1]. In this case, the z-transform of the sequence simply does not exist. If 
such cases arise, however, it may still be possible to use the z-transform by considering 
the sequence to be the sum of two sequences, each of which has a z-transform, but 
the two transforms cannot be combined in algebraic expressions, since they have no 
common ROC. 

As we indicated in comparing Examples 3.1 and 3.2, the algebraic expression or 
pole-zero pattern does not completely specify the z-transform of a sequence; i.e., the 
ROC must also be specified. The properties considered in this section limit the possible 
ROCs that can be associated with a given pole-zero pattern. To illustrate, consider 
the pole-zero pattern shown in Figure 3.10(a). From properties 1, 3, and 8, there are 
only four possible choices for the ROC These are indicated in Figures 3.10(b), (c), (d), 
and (e), each being associated with a different sequence. Specifically, Figure 3.10(b) 
corresponds to a right-sided sequence, Figure 3.10(c) to a left-sided sequence, and 
Figures 3.10(d) and 3.10(e) to two different two-sided sequences. If we assume, as 
indicated in Figure 3.10(a), that the unit circle falls between the pole at z — b and the 
pole at z = c, then the only one of the four cases for which the Fourier transform would 
converge is that in Figure 3.10(e). 

In representing a sequence through its z-transform, it is sometimes convenient 
to specify the ROC implicitly through an appropriate time-domain property of the 
sequence. This is illustrated in Example 3.7. 

Example 3.7 Stability, Causality, and the ROC 

Consider a system with impulse response h[n] for which the z-transform H(z) has the 
pole-zero plot shown in Figure 3.11. There are three possible ROCs consistent with 
properties 1-8 that can be associated with this pole-zero plot. However, if we state 
in addition that the system is stable (or equivalently, that h[n] is absolutely summable 
and therefore has a Fourier transform), then the ROC must include the unit circle. 
Thus, stability of the system and properties 1-8 imply that the ROC is the region 
i < \z\ < 2. Note that as a consequence, h[n] is two sided, and therefore, the system 
is not causal. 

If we state instead that the system is causal, and therefore that h[n] is right sided, 
then property 5 would require that the ROC be the region |z| > 2. Under this 
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Figure 3.11 Pole-zero plot for the system function in Example 3.7. 

condition, the system would not be stable; i.e., for this specific pole-zero plot, there is 
no ROC that would imply that the system is both stable and causal. 



3.3 THE INVERSE z-TRANSFORM 

One of the important roles of the z-transform is in the analysis of discrete-time linear 
systems. Often, this analysis involves finding the z-transform of sequences and, after 
some manipulation of the algebraic expressions, finding the inverse z-transform. There 
are a number of formal and informal ways of determining the inverse z-transform from 
a given algebraic expression and associated region of convergence. There is a formal 
inverse z-transform expression that is based on the Cauchy integral theorem (Churchill 
and Brown, 1990). However, for the typical kinds of sequences and z-transforms that 
we will encounter in the analysis of discrete linear time -invariant systems, less formal 
procedures are sufficient and preferable. In Sections 3.3.1-3.3.3 we consider some of 
these procedures, specifically the inspection method, partial fraction expansion, and 
power series expansion. 



3.3.1 Inspection Method 

The inspection method consists simply of becoming familiar with, or recognizing "by 
inspection," certain transform pairs. For example, in Section 3.1, we evaluated the 
z-transform for sequences of the form x[n] = a n u[n], where a can be either real or 
complex. Sequences of this form arise quite frequently, and consequently, it is particu- 
larly useful to make direct use of the transform pair 



a n u[n] 



1 



\-az~ v 
If we need to find the inverse z-transform of 



z > a 



(3.35) 



X{z) = 



1 



1-lz- 



>l 



(3.36) 
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and we recall the z-transform pair of Eq. (3.35), we would recognize "by inspection" the 
associated sequence as x[n] = Q) u[ri\. If the ROC associated with X(z) in Eq. (3.36) 
had been \z\ < \, we can recall transform pair 6 in Table 3.1 to find by inspection that 
*[n] = -(i)"«[-n-l]. 

Tables of z- transforms, such as Table 3.1, are invaluable in applying the inspection 
method. If the table is extensive, it may be possible to express a given z-transform as 
a sum of terms, each of whose inverse is given in the table. If so, the inverse transform 
(i.e., the corresponding sequence) can be written from the table. 

3.3.2 Partial Fraction Expansion 

As already described, inverse z-transforms can be found by inspection if the z-transform 
expression is recognized or tabulated. Sometimes X(z) may not be given explicitly 
in an available table, but it may be possible to obtain an alternative expression for 
X(z) as a sum of simpler terms, each of which is tabulated. This is the case for any 
rational function, since we can obtain a partial fraction expansion and easily identify 
the sequences corresponding to the individual terms. 

To see how to obtain a partial fraction expansion, let us assume that X(z) is 
expressed as a ratio of polynomials in z _1 ; i.e., 

M 

X(z) = ^ . (3.37) 

Such z-transforms arise frequently in the study of linear time -invariant systems. An 
equivalent expression is 

M 

z N J2b k z M - k - 
X(z) = — ^ ■ (3.38) 



£<^' 

k=0 

Equation (3.38) explicitly shows that for such functions, there will be M zeros and N 
poles at nonzero locations in the z-plane. In addition, there will be either M — N poles 
at z = if M > N or TV — M zeros at z = if N > M. In other words, z-transforms of the 
form of Eq. (3.37) always have the same number of poles and zeros in the finite z-plane, 
and there are no poles or zeros at z = oo. To obtain the partial fraction expansion of 
X(z) in Eq. (3.37), it is most convenient to note that X(z) could be expressed in the 
form 

M 

II( 1 - <w -1 ) 
X(z) = ^^ , (3.39) 

nc 1 -** -1 ) 



k=l 
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where the c k s are the nonzero zeros of X(z) and the d k s are the nonzero poles of X(z). 
If M < N and the poles are all first order, then X(z) can be expressed as 



N 



k=l 



A k 



dkZ' 



(3-40) 



Obviously, the common denominator of the fractions in Eq. (3.40) is the same as the 
denominator in Eq. (3.39). Multiplying both sides of Eq. (3.40) by (1 - d k z~ l ) and 
evaluating for z = <4 shows that the coefficients, A k , can be found from 



A k = {\-d kZ - l )X(z)\ z=dk . 
Example 3.8 Second-Order z-Transform 

Consider a sequence x[n] with z-transform 

X{z) = 



1 



(!_.,-,)(!_.,-,) 



Izl> 



(3.41) 



(3.42) 



3m z-plane 




Figure 3.12 Pole-zero plot and ROC for Example 3.8. 

The pole-zero plot for X(z) is shown in Figure 3.12. From the region of convergence 
and property 5, Section 3.2, we see that x[n] is a right-sided sequence. Since the poles 
are both first order, X(z) can be expressed in the form of Eq. (3.40); i.e., 

A 2 



X{z) = 



+ 



(,_!,-.) (1-1,-.) 



FromEq. (3.41), 



yi, = (1 - 4 V) X(z)\^ /4 = -1. 
A2=(l-$Z-l)X(z)\ =2. 



Therefore, 



X(z) = 



-1 



+ 



(1-1,-) (l-ir') 
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Since x[n] is right sided, the ROC for each term extends outward from the outermost 
pole. From Table 3.1 and the linearity of the z-transform, it then follows that 

*[«] = 2 f j ) "M - f 4 J "M • 

Clearly, the numerator that would result from adding the terms in Eq. (3.40) would 
be at most of degree (N — 1) in the variable z _1 . If M > N, then a polynomial must 
be added to the right-hand side of Eq. (3.40), the order of which is (M — N). Thus, for 
M > N, the complete partial fraction expansion would have the form 

M-N N . 

r=0 Jk=l l akZ 

If we are given a rational function of the form of Eq. (3.37), with M > N, the B r 's can 
be obtained by long division of the numerator by the denominator, with the division 
process terminating when the remainder is of lower degree than the denominator. The 
y4*'s can still be obtained with Eq. (3.41). 

If X(z) has multiple-order poles and M > N, Eq. (3.43) must be further modified. 
In particular, if X(z) has a pole of order s at z = d[ and all the other poles are first-order, 
then Eq. (3.43) becomes 

m-n N a s r 

*«> - E *><* \ E r^ - E jv^r- *"> 

The coefficients Ak and B r are obtained as before. The coefficients C m are obtained 
from the equation 

1 ( d s ~ m 1 

c " = (,-.)■(-*).- {s^K 1 - *W- X A^ ■ (3 ' 45) 

Equation (3.44) gives the most general form for the partial fraction expansion of a 
rational ^-transform expressed as a function of z~ l for the case M > N and for d t a pole 
of order s. If there are several multiple-order poles, there will be a term like the third 
sum in Eq. (3.44) for each multiple-order pole. If there are no multiple-order poles, 
Eq. (3.44) reduces to Eq. (3.43). If the order of the numerator is less than the order 
of the denominator (M < N), then the polynomial term disappears from Eqs. (3.43) 
and (3.44). 

It should be emphasized that we could have achieved the same results by assuming 
that the rational z-transform was expressed as a function of z instead of z~ l . That is, 
instead of factors of the form (1 — az~ r ), we could have considered factors of the form 
(z — a). This would lead to a set of equations similar in form to Eqs. (3.39)-(3.45) that 
would be convenient for use with a table of z-transforms expressed in terms of z. Since 
Table 3.1 is expressed in terms of z _1 , the development we pursued is more useful. 

To see how to find the sequence corresponding to a given rational z-transform, let 
us suppose that X{z) has only first-order poles, so that Eq. (3.43) is the most general 
form of the partial fraction expansion. To find x[n], we first note that the z-transform 
operation is linear, so that the inverse transform of individual terms can be found and 
then added together to form x[n]. 
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The terms B r z~ r correspond to shifted and scaled impulse sequences, i.e., terms 
of the form B r 8[n — r]. The fractional terms correspond to exponential sequences. To 
decide whether a term A 



1 - d k z~ l 
corresponds to (dk) n u[n] or — {dk) n u[— n — 1], we must use the properties of the region of 
convergence that were discussed in Section 3.2. From that discussion, it follows that if 
X(z) has only simple poles and the ROC is of the form tr < \z\ < r^, then a given pole d k 
will correspond to a right-sided exponential (d k ) n u[n\ if \d k \ < r^, and it will correspond 
to a left-sided exponential if |d*| > r^. Thus, the region of convergence can be used 
to sort the poles. Multiple-order poles also are divided into left-sided and right-sided 
contributions in the same way. The use of the region of convergence in finding inverse 
z- transforms from the partial fraction expansion is illustrated by the following examples. 

Example 3.9 Inverse by Partial Fractions 

To illustrate the case in which the partial fraction expansion has the form of Eq. (3.43), 
consider a sequence x[n] with z-transform 



X(z) = 



1 + 2z~ l + z~ 2 



— 1\2 



(1 + Z- 1 ) 



(l-lz-Oa-z- 1 )' 



lzl>l. 



(3.46) 



z-plane 




Figure 3.13 Pole-zero plot for the z-transform in Example 3.9. 

The pole-zero plot for X(z) is shown in Figure 3.13. From the region of convergence 
and property 5, Section 3.2, it is clear that x[n] is a right-sided sequence. Since M = 
N = 2 and the poles are all first order, X{z) can be represented as 

Ai A 2 



X(z) = Bo + 



1,-1 



+ 



1-r 



The constant Bq can be found by long division: 

2 



1 ,-2 



3,-1 



-i Z fZ 



+ 1 \ z - l + 2z~ l + \ 
z~ 2 - 3z- ! + 2 



Sz- 1 - 1 
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Since the remainder after one step of long division is of degree 1 in the variable z x , 
it is not necessary to continue to divide. Thus, X(z) can be expressed as 



X(z) =2 + 



-\+5z 



(l-Iz-OCl-z- 1 ) 



(3.47) 



Now the coefficients A\ and A2 can be found by applying Eq. (3.41) to Eq. (3.46) or, 
equivalently, Eq. (3.47). Using Eq. (3.47), we obtain 



A: = 



A 7 = 



2 + 



2 + 



-1+5Z- 1 



Therefore, 



(l_i z -i) ( l_ z -i) 

-1+Sz- 1 
(l_i z -i)(l_ z -i) 

X(z)=2- 



1 

1 -=z 



-1 



= -9. 



J z=\/2 



(1-z -1 ) 



J z =l 



+ 



!-!*-< l-^ 1 



(3.48) 



From Table 3.1, we see that since the ROC is \z\ > 1, 

2 J^ 28[nl 



2 Z 
1 



Z 

+ * 



G)"»M. 



< — > u[n\. 



1-z- 1 
Thus, from the linearity of the z-transform, 

x[n] = 28[n] - 9 (\)" u[n] + Su[n]. 

In Section 3.4 we will discuss and illustrate a number of properties of the 
^-transform that, in combination with the partial fraction expansion, provide a means 
for determining the inverse ^-transform from a given rational algebraic expression and 
associated ROC, even when X{z) is not exactly in the form of Eq. (3.39). 



3.3.3 Power Series Expansion 

The defining expression for the z-transform is a Laurent series where the sequence 
values x[n] are the coefficients of z~~ n . Thus, if the ^-transform is given as a power series 
in the form 



X(z) = JT x[n]z- n 

= • • ■ + x[-2]z 2 + x[-l]z + x[0] + x[l]z~ l + x[2]z~ 2 + 



(3.49) 



we can determine any particular value of the sequence by finding the coefficient of the 
appropriate power of z -1 . We have already used this approach in finding the inverse 
transform of the polynomial part of the partial fraction expansion when M > N. This 
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approach is also very useful for finite-length sequences where X(z) may have no simpler 
form than a polynomial in z _1 . 

Example 3.10 Finite-Length Sequence 

Suppose X(z) is given in the form 

X{z) = z 2 (1 - \z~ x ) (1 + z- J )(l - z- 1 ). (3.50) 

Although X(z) is obviously a rational function, its only poles are at z = 0, so a partial 
fraction expansion according to the technique of Section 3.3.2 is not appropriate. 
However, by multiplying the factors of Eq. (3.50), we can express X{z) as 

X( z ) = z 2 -\z-l + \z- x . 
Therefore, by inspection, x[ri\ is seen to be 

' 1, n = -2, 
-\, n = -l, 
x[n] = < -1, n = 0, 

I « = 1. 
, 0, otherwise. 

Equivalently, 

x[n] = 8[n + 2] - \b[n + 1] - <5[n] + ^[n - 1]. 



In finding z-transforms of a sequence, we generally seek to sum the power series 
of Eq. (3.49) to obtain a simpler mathematical expression, e.g., a rational function. If 
we wish to use the power series to find the sequence corresponding to a given X(z) 
expressed in closed form, we must expand X(z) back into a power series. Many power 
series have been tabulated for transcendental functions such as log, sin, sinh, etc. In 
some cases such power series can have a useful interpretation as z-transforms, as we 
illustrate in Example 3.11. For rational z-transforms, a power series expansion can be 
obtained by long division, as illustrated in Examples 3,12 and 3.13. 



Example 3.1 1 Inverse Transform by Power 
Series Expansion 

Consider the z-transform 

X{z) = \og{l+az- x ), \z\>\a\. (3.51) 

Using the power series expansion for log(l + x), with |*| < 1, we obtain 

(-l) n+1 a n z~ n 



*(*) = E 
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Therefore, 



w.+l fl 



*M = S « ~ ( 3 - 52 ) 

0, n < 0. 



Example 3.12 Power Series Expansion by 
Long Division 



X(z)=- — , Iz|>lfl|. (3.53) 



Consider the ^-transform 

J_ 

1 — az~ 

Since the region of convergence is the exterior of a circle, the sequence is a right-sided 
one. Furthermore, since X(z) approaches a finite constant as z approaches infinity, the 
sequence is causal. Thus, we divide, so as to obtain a series in powers of £ _1 . Carrying 
out the long division, we obtain 

l+az' 1 + a 2 z~ 2 + --- 
1 - az~ l fl 

\-az~ l 
az~ l 

-1 2 -2 

2 -2 



or 



r = 1 -f az~ l 4- a V 2 + 

1 - flZ- 1 



Hence, jc[h] = a"u[n]. 



Example 3.1 3 Power Series Expansion for a 
Left-Sided Sequence 

As another example, we can consider the same ratio of polynomials as in Eq. (3.53), 
but with a different region of convergence: 

X{z) = 1 1 Y , |z|<|fl|. (3.54) 

1 — az~ v 

Because of the region of convergence, the sequence is a left-sided one, and since X(z) 
at z = is finite, the sequence is zero for n > 0. Thus, we divide, so as to obtain a series 
in powers of z as follows: 



-1 -2 -2 

— a l z — a z — 



-a + z \z 



z-a-h 2 
a~h 2 



Therefore, x[n] = —a n u[—n — 1]. 
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3.4 z-TTCANSFORM PROPERTIES 

Many of the properties of the z-transform are particularly useful in studying discrete- 
time signals and systems. For example, these properties are often used in conjunction 
with the inverse z-transform techniques discussed in Sec. 3.3 to obtain the inverse z- 
transform of more complicated expressions. In Chapter 5 we will see that the properties 
also form the basis for transforming linear constant-coefficient difference equations to 
algebraic equations in terms of the transform variable z, the solution to which can then 
be obtained using the inverse z-transform. In this section, we consider some of the most 
frequently used properties. In the following discussion, X(z) denotes the z-transform 
of x[n], and the ROC of X(z) is indicated by R x ; i.e., 

x[n] JU X(z), ROC= R x . 

As we have seen, R x represents a set of values of z such that r R < \z\ < r L . For 
properties that involve two sequences and associated z-transforms, the transform pairs 
will be denoted as 

*,[«] <^> X x (z\ ROC=/^, 
x 2 [n] ^ X 2 {z), ROC = R Xl . 

3.4.1 Linearity 

The linearity property states that \ 

ax\[n] + bx 2 [n] < — > aX x (z) + bX 2 (z), ROC contains R Xl n R X2 , 

and follows directly from the z-transform definition, Eq. (3.2). As indicated, the region 
of convergence is at least the intersection of the individual regions of convergence. 
For sequences with rational z-transforms, if the poles of aXi(z) + bX 2 (z) consist of 
all the poles of X\(z) and X 2 (z) (i.e., if there is no pole-zero cancellation), then the 
region of convergence will be exactly equal to the overlap of the individual regions 
of convergence. If the linear combination is such that some zeros are introduced that 
cancel poles, then the region of convergence may be larger. A simple example of this 
occurs when x\[n] and x 2 [n] are of infinite duration, but the linear combination is of 
finite duration. In this case the region of convergence of the linear combination is the 
entire z-plane, with the possible exception of z = or z = oo. An example was given in 
Example 3.6, where x[n] can be expressed as 

x[n] = a n u[n] — a n u[n — N]. 

Both a n u[n\ and a n u\n — N] are infinite-extent right-sided sequences, and their 
z-transforms have a pole at z = a. Therefore, their individual regions of convergence 
would both be \z\ > \a\. However, as shown in Example 3.6, the pole at z = a is can- 
celed by a zero at z = a, and therefore, the ROC extends to the entire z-plane, with the 
exception of z = 0. 

We have already exploited the linearity property in our previous discussion of the 
use of the partial fraction expansion for evaluating the inverse z-transform. With that 
procedure, X(z) is expanded into a sum of simpler terms, and through linearity, the 
inverse z-transform is the sum of the inverse transforms of each of these terms. 
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3.4.2 Time Shifting 

According to the time-shifting property, 

x[n - n ] +^-+ z'^Xiz), ROC = /^(except for the 

possible addition or 
deletion of z — or z = oo). 

The quantity no is an integer. If no is positive, the original sequence x[n] is shifted right, 
and if no is negative, x[n] is shifted left. As in the case of linearity, the ROC can be 
changed, since the factor z _n ° can alter the number of poles at z = or z = oo. 

The derivation of this property follows directly from the z-transform expression 
in Eq. (3.2). Specifically, if y[n] = x[n — n Q ], the corresponding z~ transform is 

oo 
n=~ oo 

With the substitution of variables m = n — no, 

oo 

Y(z)= ]T x[m]z- (m+no) 



= z~ n ° 


]T x[m]z~ 

m=— oo 


-m 


Y(z) = 


z-"*X(z). 





or 



The time-shifting property is often useful, in conjunction with other properties 
and procedures, for obtaining the inverse z-transform. We illustrate with an example. 

Example 3.14 Shifted Exponential Sequence 

Consider the z-transform 

X(z)=^- T , \z\> \. 

From the ROC, we identify this as corresponding to a right-sided sequence. We 
can first rewrite X(z) in the form 

This z-transform is of the form of Eq. (3.39) with M = N = 1, and its expansion in the 
form of Eq. (3.43) is 

X(z) = -4+ \ (3.56) 

From Eq. (3.56), it follows that x[n] can be expressed as 



x[/i] = -«[n]+4(J)"ii[/i]. (3.57) 
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An expression for x[n] can be obtained more directly by applying the time-shifting 
property. First, X(z) can be written as 

X{z) = z- l (--^Y \z\>\. (3.58) 

From the time-shifting property, we recognize the factor z~ ] in Eq. (3.58) as being 
associated with a time shift of one sample to the right of the sequence (^) u[n]; i.e., 

x[n]=(l)"- l u[n-\}. (3.59) 

It is easily verified that Eqs. (3.57) and (3.59) are the same for all values of n; i.e., they 
represent the same sequence. 

3.4.3 Multiplication by an Exponential Sequence 

The exponential multiplication property is expressed mathematically as 

Zox[n] +£+ X(z/zo), ROC = \z \R x . 

The notation ROC = Izol^ denotes that the ROC is R x scaled by |zol; i.e., if R x is the 
set of values of z such that tr < \z\ < r^ then \zq\R x is the set of values of z such that 
\zo\r R < \z\ < \zo\r L - \ 

This property is easily shown simply by substituting zd^Minto Eq. (3.2). As a 
consequence of the exponential multiplication property, all the pole-zero locations are 
scaled by a factor zo, since, if X(z) has a pole at z = Z\ , then X(zq ' z) will have a pole at 
z = zqZ\. If Zo is a positive real number, the scaling can be interpreted as a shrinking or 
expanding of the z-plane; i.e., the pole and zero locations change along radial lines in the 
z-plane. If zo is complex with unity magnitude, so that zo = e ;wn , the scaling corresponds 
to a rotation in the z-plane by an angle of coq; i.e., the pole and zero locations change 
in position along circles centered at the origin. This in turn can be interpreted as a 
frequency shift or translation, associated with the modulation in the time domain by 
the complex exponential sequence e^ ". That is, if the Fourier transform exists, this 
property has the form 

e iQ,on x[n] ^-> Xie^-^). 



Example 3.15 Exponential Multiplication 

Starting with the transform pair 

u[n] JU * _ t , \z\ > 1, (3.60) 

we can use the exponential multiplication property to determine the z-transform of 

x[n] = r n cos((DQn)u[n]. (3.61) 

First, x[n] is expressed as 

x[n] = \{re^) n u[n] + \(re-^) n u[n\. 
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Then, using Eq. (3.60) and the exponential multiplication property, we see that 

z i 
Ure>^) n u[n\ *±+ 1 | z | > r , 

z i 
Ure-^) n u[n] *±+ - 2 - r , \z\ > r. 

From the linearity property, it follows that 

i I 

X(Z) = - ~. r + - L r, \l\>r 



(1 —rcosa>oz l ) 
1 - 2r cos (dqz~ 1 4- r 2 z -2 ' 



(3.62) 



\Z\ > r. 



3.4.4 Differentiation of X[z) 

The differentiation property states that 

nx[n] 4^+ -z^4^- ROC = R x . 

dz 

This property is verified by differentiating the z-transform expression of Eq. (3.2); i.e., 

00 

*(z) = E *[»]«""• 

n=-oo 

dX(z) y-^ \ r i -n-1 

-Z— ^— = -Z^ (-»)*[«]* 

n=— oo 

00 

= ^ nx[n]r" = Z{nx[n]}. 

n=—oo 

We illustrate the use of the differentiation property with two examples. 
Example 3.16 Inverse of Non-Rational z-Transform 

In this example, we use the differentiation property together with the time-shifting 
property to determine the inverse z-transform considered in Example 3.11. With 

X(z) = \og(l+a Z - 1 ), \z\ > \a\, 

we first differentiate to obtain a rational expression: 

dX(z) _ ~az~ 2 
dz ~ 1 +az~ x ' 

From the differentiation property, 

Z dX(z) az~ l 

nx[n\ < — ► -Z-: — = — r, |z| > |fl|- (3.63) 

dz 1 +az l 
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The inverse transform of Eq. (3.63) can be obtained by the combined use of the 
z-transform pair of Example 3.1, the linearity property, and the time-shifting property. 
Specifically, we can express nx[n] as 

nx[n] = a(~a) n - ] u[n- 1]. 
Therefore, 

x[n] = (-1)" +1 —u[n - 1] ^ log(l + az- 1 ), \z\ > |a|. 

Example 3.17 Second-Order Pole 

As another example of the use of the differentiation property, let us determine the 
z-transform of the sequence 

x[n] — na"u[n] = n(a n u[n]). 

From the z-transform pair of Example 3.1 and the differentiation property, it follows 
that 



az ] 



(1-flz- 1 ) 



-l\2' 



z > a 



Therefore, 



z az } 



na n u[n] < — > r - y , \z\ > \a\ 

(1 — az" K Y 



3.4.5 Conjugation of a Complex Sequence 

The conjugation property is expressed as 

x*[n] <JU X*(z*), ROC = R x . 

This property follows in a straightforward manner from the definition of the z-transform, 
the details of which are left as an exercise (Problem 3.51). 

3.4.6 Time Reversal 

By the time-reversal property, 

x*[-n] *^+ AT*(l/z*), ROC = -i-- 

R 



X 



The notation ROC = 1/R X implies that R x is inverted; i.e., if R x is the set of values of z 
such that rR < \z\ < r^, then the ROC is the set of values of z such that l/r^ < \z\ < 1 /tr. 
Thus, if zo is in the ROC for x[n], then 1/zJ is in the ROC for the z-transform of x*[— ri\. 
If the sequence x[n] is real or we do not conjugate a complex sequence, the result 

becomes 

x[-n] <^+ X(l/z), ROC = ^-. 
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As with the conjugation property, the time-reversal property follows easily from the 
definition of the z-transform, and the details are left as an exercise (Problem 3.51 ). 

Example 3.18 Time-Reversed Exponential Sequence 

As an example of the use of the property of time reversal, consider the sequence 

x[n] = a~ n u[—n], 

which is a time-reversed version of a n u[n]. From the time-reversal property, it follows 
that 



1 _ -a" 1 ;- 1 
1 - az 1 — a~^z~ ] ' 



X(z)=- = i TT-TT' |Z|<|A 



-1 



3.4.7 Convolution of Sequences 

According to the convolution property, 

*\[n] *x 2 [n] < — ► X\(z)X 2 (z), ROC contains R Xy n R X2 
To derive this property formally, we consider 

y[n] = ^2 xi[k]x 2 [n - k], 

k=—oo 

so that 



y(z) = J2 y^ z ~" 



n=—oo 

oo ( oo 



= E E ^lk]x 2 [n-k]\z-". 

n=-oo Kk=-oo ) 

If we interchange the order of summation, 

oo oo 

Y(z)= J2 *iM E x 2[n-k] Z -". 

k= — 00 J7= — oo 

Changing the index of summation in the second sum from n to m = n — k, we obtain 

oo ( oo "1 

Y(z)= Y, x M{ E x 2[m]z- m \z 



Thus, for values of z inside the regions of convergence of both X\ (z) and X 2 (z), we can 
write 

Y(z) = X l (z)X 2 (zl 

where the region of convergence includes the intersection of the regions of convergence 
of X\(z) and X 2 (z). If a pole that borders on the region of convergence of one of the 
z- transforms is canceled by a zero of the other, then the region of convergence of Y (z) 
may be larger. As we develop and exploit it in Chapter 5, the convolution property 
plays a particularly important role in the analysis of LTI systems. Specifically, as a con- 
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sequence of this property, the z-transf orm of the output of an LTI system is the product 
of the z-transform of the input and the z- transform of the system impulse response. The 
z- transform of the impulse response of an LTI system is typically referred to as the 
system function. 



Example 3.19 Evaluating a Convolution Using 
the z-Tfransform 

Let x\[n] = a n u[n] and X2[n] = u[n]. The corresponding z-transforms are 

°° 1 
Xi(z) = y^a n z~ n = r, \z\ > \a\, 

rt=0 

and 

X 2 (z) = ^2z- n = Y —^ T , \z\>l. 



n=0 



lf\a\ < 1, the z-transform of the convolution of x\ [n] with X2[n] is then 



Y(z) = 



1 



(l-flz-i)(l-z-i) (z-^Kz-l) 1 



z-plane 



Izl > 1. 







Region of 

%fifiM ^fttffifsal: ftlftfe : convergence 






(3.64) 



Figure 3.14 Pole-zero plot for the z-transform of the convolution of the 
sequences u[n] and a n u[ri\. 

The poles and zeros of Y(z) are plotted in Figure 3.14, and the region of convergence 
is seen to be the overlap region. The sequence y[n] can be obtained by determining 
the inverse z-transform. Expanding Y(z) in Eq. (3.64) in a partial fraction expansion, 
we get 



Y(z) = 



1 



1 



1-fl Vl-z" 1 1-flz- 1 J ' 



Izl > 1. 



Therefore, 



y[n] = Y —{u[n\-a^u[n\). 
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TABLE 3.2 SOME z-TRANSFORM PROPERTIES 



Section 
Reference 



Sequence 



Transform 


ROC 


X(z) 


R x 


Xx{z) 


**i 


Xi{z) 


Rx 2 


aX\{z)+bX 2 {z) 


Contains R Xl n R X2 


z-" Q X(z) 


R x , except for the possible 
addition or deletion of 




the origin or oo 


X(z/zo) 


\zo\R x 


dX{z) 
Z dz 


R x , except for the possible 
addition or deletion of 




the origin or oo 


X*{z*) 


R x 


\[X{z) + X*{z*)\ 


Contains R x 



x[n] 
X] [n] 
x 2 [n] 

3.4.1 ax\[n] + bx 2 [n] 

3.4.2 x[n — no] 

3.4.3 zgjc[«] 

3.4.4 nx[n] 

3.4.5 x*[n] 
Tle[x[n]} 

Jm{x[n]} 

3.4.6 x*[-n] 

3.4.7 ^i[«]*JC2[«] 

3.4.8 Initial-value theorem: 
x[n] = 0, n < 



Y.[X(z)-X*(z*)] Contains /e x 

X m (l/z m ) l/Rx 

X\{z)X 2 {z) Contains R X] n R X2 



lim X{z) = x[0] 



3.4.8 Initial-Value Theorem 

If x[n] is zero for n < (i.e., if x[n] is causal), then 

*[0] = lim X(z). 



Z^>OQ 



This theorem is shown by considering the limit of each term in the series of Eq. (3.2). 
(See Problem 3.56.) 

3.4.9 Summary of Some z-Transform Properties 

We have presented and discussed a number of the theorems and properties of 
z-transforms, many of which are useful in manipulating z-transforms. These proper- 
ties and a number of others are summarized for convenient reference in Table 3.2. 



3.5 SUMMARY 

In this chapter, we have defined the z-transform of a sequence and shown that it is a 
generalization of the Fourier transform. The discussion focused on the properties of 
the z-transform and techniques for obtaining the z-transform of a sequence and vice 
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versa. Specifically, we showed that the defining power series of the z-transform may 
converge when the Fourier transform does not. We explored in detail the dependence 
of the shape of the region of convergence on the properties of the sequence. A full 
understanding of the properties of the region of convergence is essential for successful 
use of the z- transform. This is particularly true in developing techniques for finding 
the sequence that corresponds to a given z-transform, i.e., finding inverse z-transforms. 
Much of the discussion focused on z-transforms that are rational functions in their region 
of convergence. For such functions, we described a technique of inverse transformation 
based on the partial fraction expansion of X(z). We also discussed other techniques for 
inverse transformation, such as the use of tabulated power series expansions and long 
division. 

An important part of the chapter was a discussion of some of the many properties 
of the z-transform that make it useful in analyzing discrete-time signals and systems. A 
variety of examples demonstrated how these properties can be used to find direct And 
inverse z-transforms. 



PROBLEMS 



Basic Problems with Answers 



3.1. 


Determine the z- 


-transform, 


including 


the region of < 


convergence, 


for each of the 


following 




sequences: 




















(a) (\) n u[n] 




















(b) -{\) n u[-n 


-1] 


















(c) (\) n u[-n] 




















(d) 8[n] 




















(e) S[n - 1] 




















(f) 5[n + l] 




















(g) {\T(u[n]- 


u[n - 


-10]) 














3.2. 


Determine the z- 


-transform of the sequence 


















x[n] = \ 




0<n< 
N <n. 


; N-i, 







3.3. Determine the z-transform of each of the following sequences. Include with your answer 
the region of convergence in the z-plane and a sketch of the pole-zero plot. Express all 
sums in closed form; a can be complex. 
< led < 1. 



(a) x a [n] = a |n| 

(b) x b [n] = 



{i 



0<n< JV-1, 
otherwise. 



{n, < n < N, 

2N-n, N+l<n<2N, 
0, otherwise. 

Hint: Note that xt,[n] is a rectangular sequence and x c [n] is a triangular sequence. First 
express x c [n] in terms of Xb[n]. 
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3.4. Consider the z-transform X(z) whose pole-zero plot is as shown in Figure P3.4-1. 

(a) Determine the region of convergence of X(z) if it is known that the Fourier transform 
exists. For this case, determine whether the corresponding sequence x[n] is right sided, 
left sided, or two sided. 

(b) How many possible two-sided sequences have the pole-zero plot shown in Fig- X 
ureP3.4-l? 

(c) Is it possible for the pole-zero plot in Figure P3.4-1 to be associated with a sequence 
that is both stable and causal? If so, give the appropriate region of convergence. 



Z-plane 



Unit circle 




Figure P3.4-1 



3.5. Determine the sequence x[n] with z-transform 

X(z) = (1 + 2z)(l + 3z" 1 )(l - z- 1 ). 



3.6. Following are several z-transforms. For each, determine the inverse z-transform using both 
methods — partial fraction expansion and power series expansion — discussed in Section 3.3. 
In addition, indicate in each case whether the Fourier transform exists. 

1 . . i 



(a) X(z) = 



(b) X(z) = 



(c) X(z) = 



(d) X(z) = 



(e) X(z) = 



1 + iz-i' 



1 + Jz- 1 ' 



z > ^ 



z < $ 



l+lz-i + ^z- 2 ' 



\Z\ > n 



1 - \z~ x 



z > 



1 — az 



-1 



\z\ > |l/fl| 



3.7. The input to a causal linear time-invariant system is 

jc[/x] = u[-n - 1] + {\) n u[n]. 
The z-transform of the output of this system is 



Y(z) = 



-?z 



i ,-i 



(i_i z -i)(i +z -.) 



(a) Determine H(z), the z-transform of the system impulse response. Be sure to specify 
the region of convergence. 

(b) What is the region of convergence for F(z)? 

(c) Determine y[n]. 
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3.8. The system function of a causal linear time-invariant system is 

H(z) = * ~f\ . 
l + - 4 z~ l 

The input to this system is 

*["] = (?)""["] + "[-" -1]- 

(a) Find the impulse response of the system, h[n], 

(b) Find the output y[n]. 

(c) Is the system stable? That is, is h[n] absolutely summable? 

3.9. A causal LTI system has impulse response h[ri\, for which the z-transform is 



(1 _. z -. )(1 + .,-.)• 

(a) What is the region of convergence of H(z)l 

(b) Is the system stable? Explain. 

(c) Find the z-transform X{z) of an input x[n] that will produce the output 

y[n] = ^(-\)"u[n]-l(2ru[-n-l]. 

(d) Find the impulse response h[n] of the system. 

3.10. Without explicitly solving for X(z), find the region of convergence of the z-transform of 
each of the following sequences, and determine whether the Fourier transform converges: 

(a) x[n]=[(±) n + (l) n ]u[n-10] 
1, -10<«<10, 



u[n — 1] 



< b > JC W=i 0i otherwise , 

(c) x[n] = 2"u[-n] 



(d) x[n] = 



\\n+4 



iXr-i.el">Y 



(e) x[n] = u[n + 10] - u[n + 5] 

(f) x[n] = (i)"" 1 u[n] + (2 4- 3jf- 2 u[-n - 1] 

3.11. Following are four z-transforms. Determine which ones could be the z-transform of a causal 
sequence. Do not evaluate the inverse transform. You should be able to give the answer by 
inspection. Clearly state your reasons in each case. 

(a) (1 - 1)2 
(b) 



(1- 


-lz- 


') 


(z- 


-l) 2 




c^- 


-i) 




(*- 


-\Y 
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3.12. Sketch the pole-zero plot for each of the following z- transforms and shade the region of 
convergence: 

1- ±z~ l 
(a) X x {z) = 1 + ^ , ROC: \z\ < 2 

(b > *« = (l + i*-0(l - |*-i) * X2[n] CaUSal 

1 + z" 1 - 2z~ 2 
(c) X${z) = ^ — , x?>[ri\ absolutely summable. 

1 - -^z -1 + z~ 2 

3.13. A causal sequence g[n] has the z-transform 

G(z) = sin^Xl + 3z' 2 + 2z' 4 ). 
Findg[ll]. 

3.14. If H(z) = -< and h[n] = Ai<x"u[n] + A2a%u[n], determine the values of Ai, Ai, ct\, 

I-4Z- 2 

and «2. 



1 )- z 

1 1024 <■ 



1_ ,-10 

24 
1 

2 



3.15. If H(z) = -^ f° r Izl > 0, is the corresponding LTI system causal? Justify your 

1 - kz' 1 

answer. 

3.16. When the input to an LTI system is 

*W=(\) "[/!] + (2)M-«-i], 

the corresponding output is 

y[n] = s(J\ u[n]-s(J\ u[n]. 

(a) Find the system function H{z) of the system. Plot the pole(s) and zero(s) of H{z) and 
indicate the region of convergence. 

(b) Find the impulse response h[n] of the system. 

(c) Write a difference equation that is satisfied by the given input and output. 

(d) Is the system stable? Is it causal? 

3.17. Consider an LTI system with input x[n] and output y [n] that satisfies the difference equation 

y[n] - ^y[n - 1] + y[n - 2] = x[n] - x[n - 1]. 

Determine all possible values for the system's impulse response h[n] at n = 0. 

3.18. A causal LTI system has the system function 

1 + 2Z" 1 + z~ 2 



H(z) = 



(l + i z -i)(l_ z -i) 



(a) Find the impulse response of the system, h[ri\. 

(b) Find the output of this system, y[n], for the input 

x[n] = e* n/2)n . 

3.19. For each of the following pairs of input z-transform X(z) and system function H(z), deter- 
mine the region of convergence for the output z-transform Y(z): 
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(a) 

1 

\z\>- 



(b) 



X{z) = 


1 


1 + iz- 1 ' 


H{z) = 


1 


1-^z- 1 ' 

1 4* 1 


X{z) = 


1 


1 - 2z~ l ' 


H(z) = 


1 


l-^" 1 ' 




1 



1 

\z\ > - 
4 



\z\<2 

1 
Ul>3 

(c) 

* W= (1 -$*-.)"(! + 3*-) ■ ^ <k ' <3 

1 + 3z _1 1 

»«> = m^' w > 3 

3.20. For each of the following pairs of input and output z-transforms X(z) and Y (z), determine 
the region of convergence for the system function H(z): 

(a) 

X(z)=—^, \z\>- 
(b) 

yw= (i-^)V + i-')' ^ <lzl< ^ 

Basic Problems 

3.21. Consider a linear time-invariant system with impulse response 

a", « > 0, 



L J 10, n < 0, 
and input 

,[„,_/!• 0<i,s(JV-l), 
J 10, otherwise. 

(a) Determine the output y[n] by explicitly evaluating the discrete convolution of x[n] 
and h[ri\. 

(b) Determine the output y[n] by computing the inverse z-transform of the product of 
the z-transforms of x[n] and h[n]. 
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3.22. Consider an LTI system that is stable and for which H(z), the z-transform of the impulse 
response, is given by 

Suppose x[n], the input to the system, is a unit step sequence. 

(a) Find the output y[n] by evaluating the discrete convolution of x[n] and h[n]. 

(b) Find the output y[n] by computing the inverse z-transform of Y(z). 

3.23. An LTI system is characterized by the system function 

(l-U- 2 ) 1 

(a) Determine the impulse response of the system. 

(b) Determine the difference equation relating the system input x[n] and the system 
output y[n]. 

3.24. Sketch each of the following sequences and determine their z-transforms, including the 
region of convergence: 



(a) ^ 5 l n ~ 4k \ 

k=—<x 

(b) X - [*'™ + cos(|«)+sin(|+2;ni) 



k=—oc 

/ IT \ / TT \ 1 

u[n] 

3.25. Consider a right-sided sequence x[n\ with z-transform 

1 z 2 



X{z) = 



(l-az- l )(l-bz- 1 ) (z-a)(z-b) 



In Section 3.3 we considered the determination of x[n] by carrying out a partial fraction 
expansion, with X{z) considered as a ratio of polynomials in z _1 . Carry out a partial frac- 
tion expansion of X(z), considered as a ratio of polynomials in z, and determine x[n] from 
this expansion. 

Advanced Problems 

3.26. Determine the inverse z-transform of each of the following. In Parts (a)-(c), use the methods 
specified. In Part (d), use any method you prefer. 
(a) Long division: 

i - V 1 

X{z) — y , x[n] a right-sided sequence 

1 + 3Z- 1 



(b) Partial fraction: 



(c) Power series: 



3 
X ^ = 1 ~ IT' *["] stable 

Z ~ 4 _ 8 Z 



X{z) = ln(l - 4z), \z\ < \ 



(d) X(z)= . _ 3 , kl>(3)- 1/3 

1 1 z 
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3.27. Using any method, determine the inverse z-transform for each of the following: 

(a) X(z) = ^ , stable sequence 

(l + ^z- 1 ) (l-2z- l )(l-3z- 1 ) 

(b) X(z) = e* x 

Z' 



(c) X(z) = 



3 2z 



left-sided sequence 



z-2 ' 

3.28. Determine the inverse z- transform of each of the following. You should find the z- transform 
properties in Section 3.4 helpful. 

3z" 3 



(a) X(z) = 



.2' 



x[n] left sided 



(i -!*->)■ 

(b) X(z) = sin(z), ROC includes \z\ = 1 

z 7 -2 



(c) X{z) = 



\z\>l 



1-z-t 

3.29. Determine a sequence x[n] whose z-transform is X(z) = e z + e 1/z , z ^ 0. 

3.30. Determine the inverse z-transform of 



by 

(a) using the power series 



X(z) = log2(\-z), |z|<±, 



log(l-*) = -^y, |jc|<1; 



(b) first differentiating X(z) and then using the derivative to recover x[ri\. 

3.31. For each of the following sequences, determine the z- transform and region of convergence, 
and sketch the pole-zero diagram: 

(a) x[n] = a"u[n] + b"u[n] + c"u[-n - 1], \a\ < \b\ < \c\ 

(b) x[n] = n 2 a"u[n] 

(c) x[n] — e" A cos {— «) u[n] - e"* cos ( T^ n ) u [n - 1] 

332. The pole-zero diagram in Figure P3.32-1 corresponds to the z-transform X(z) of a causal 
sequence x[n]. Sketch the pole-zero diagram of Y (z), where y[n] = x[—n-\-?>]. Also, specify 
the region of convergence for Y (z). 



z -plane 




Figure P3.32-1 

3.33. Let x[n] be the sequence with the pole-zero plot shown in Figure P3.33-1. Sketch the 
pole-zero plot for: 

(a) y[n]=($) n x[n] 
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(b) w[n] = cost ^- J x[n] 



z-plane 




Figure P3.33-1 

3.34. Consider an LTI system that is stable and for which H(z), the z-transform of the impulse 
response, is given by 

3-lz- l +5z~ 2 



H{z) = 



\-{z~ x + z- 2 



Suppose x[n], the input to the system, is a unit step sequence. 

(a) Find the output y[n] by evaluating the discrete convolution of x[n] and h[n]. 

(b) Find the output y[n] by computing the inverse z-transform of Y{z). 

3.35. Determine the unit step response of the causal system for which the z-transform of the 
impulse response is 

1-z 3 



H(z) = 



1-z' 



3.36. If the input x[n] to an LTI system is x[n] = u[n], the output is 

(a) Find H(z), the z-transform of the system impulse response, and plot its pole-zero 
diagram. 

(b) Find the impulse response h[ri\. 

(c) Is the system stable? 

(d) Is the system causal? 

3.37. Consider a sequence x[n] for which the z- transform is 



X(z) = 



+ 



1-iz-i 1-2* 



-l 



and for which the region of convergence includes the unit circle. Determine jc[0] using the 
initial-value theorem. 



3.38. Consider a stable linear time-invariant system. The z-transform of the impulse response is 

H{z) = 



z-' + z' 2 



(l-i^l)(l + ^l)- 

Suppose x[n], the input to the system, is 2u[n]. Determine y[n] at n = 1. 
3.39. Suppose the z-transform of x[n] is 



,10 



X(z) = 



(z-i^-D'VDViKz+S) 
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It is also known that x[n] is a stable sequence. 

(a) Determine the region of convergence of X{z). 

(b) Determine x[n] at n — -8. 

3.40. In Figure P3.40-1, H(z) is the system function of a causal LTI system. 

(a) Using ^-transforms of the signals shown in the figure, obtain an expression for W(z) in 
the form 

W(z) = Hi(z)X(z)+ H 2 (z)E(z), 

where both H\{z) and Hj{z) are expressed in terms of H(z). 

(b) For the special case H(z) = z~ l /(l — z _1 ), determine H\{z) and Hi(z). 

(c) Is the system H(z) stable? Are the systems H\{z) and Hiiz) stable? 



x[n] 



*&. 



v[n] 



H(Z) 



e[n] 



t0 



w[n] 



Figure P3.40-1 



3.41. In Figure P3.41-1, h[n] is the impulse response of the LTI system within the inner box. The 
input to system h[n] is v[n], and the output is w[n]. The z-transform of h[n], H(z), exists in 
the following region of convergence: 

< r min < \z\ < r max < oo. 

(a) Can the LTI system with impulse response h[n] be BIBO stable? If so, determine 
inequality constraints on r m [ n and r max such that it is stable. If not, briefly explain why. 

(b) Is the overall system (in the large box, with input x[n] and output y[n]) LTI? If so, find 
its impulse response g[ri\. If not, briefly explain why. 

(c) Can the overall system be BIBO stable? If so, determine inequality constraints relating 
of, r m i n , and r max such that it is stable. If not, briefly explain why. 




Figure P3.41-1 



3.42. A causal and stable LTI system S has its input x[n] and output y[n] related by the linear 
constant-coefficient difference equation 



10 



yW + 5Z aky l n ~ k \ = *M + P x [ n ~ !]■ 



Jt=l 

Let the impulse response of S be the sequence h[n\. 

(a) Show that /i[0] must be nonzero. 

(b) Show that ct\ can be determined from the knowledge of /i[0] and h[\]. 

(c) If h[n] = (0.9) rt cos(;r/2/4) for < n < 10, sketch the pole-zero plot for the system 
function of S, and indicate the region of convergence. 
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3.43. When the input to an LTI system is 



n 



x[n]=[\) u[n] + 2"u[-n-ll 



the output is 



(a) Find the system function H{z) of the system. Plot the poles and zeros of H(z), and 
indicate the region of convergence. 

(b) Find the impulse response h[n] of the system. 

(c) Write the difference equation that characterizes the system. 

(d) Is the system stable? Is it causal? 

3.44. When the input to a causal LTI system is 



the z-transform of the output is 

Y(z) = 



\ + z 



-i 



(1-Z-')(1 + $*-') (1-2*-') 



(a) Find the z-transform of x[ri\. 

(b) What is the region of convergence of y(z)? 

(c) Find the impulse response of the system. 

(d) Is the system stable? 

3.45. Let x[n] be a discrete-time signal with x[n] — for n < and z-transform X(z). Further- 
more, given x[n], let the discrete-time signal y[n] be defined by 



^ ] = \0, o 



>0, 
otherwise. 



(a) Compute Y(z) in terms of X(z). 

(b) Using the result of Part (a), find the z-transform of 



w[«] = , , r M n - 1]. 



3.46. The signal y[n] is the output of an LTI system with impulse response h[n] for a given input 
x[n]. Throughout the problem, assume that y[n] is stable and has a z-transform Y(z) with the 
pole-zero diagram shown in Figure P3.46-1. The signal x[n] is stable and has the pole-zero 
diagram shown in Figure P3.46-2. 
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-4- \~ 

1 1 



-1 



1 



z-plane 



Figure P3.46-1 




z-plane 



Figure P3.46-2 



(a) What is the region of convergence, Y (z)? 

(b) Is y[n] left sided, right sided, or two sided? 

(c) What is the ROC of A'(z)? 

(d) Is x[n] a causal sequence? That is, does x[n] — for n < 0? 

(e) Whatisx[0]? 

(f) Draw the pole-zero plot of H{z), and specify its ROC. 

(g) Is h[n] anticausal? That is, does h[n] — for n > 0? 



Extension Problems 



3.47. Let x[n] denote a causal sequence; i.e., x[n] =0,n < 0. Furthermore, assume that x[0] ^ 0. 

(a) Show that there are no poles or zeros of X(z) at z = oo, i.e., that lim X{z) is nonzero 
and finite. 

(b) Show that the number of poles in the finite z-plane equals the number of zeros in the 
finite z-plane. (The finite z-plane excludes z = oo.) 

3.48. Consider a sequence with z-transform X{z) = P(z)/Q(z), where P(z) and Q(z) are poly- 
nomials in z. If the sequence is absolutely summable and if all the roots of Q(z) are inside 
the unit circle, is the sequence necessarily causal? If your answer is yes, clearly explain. If 
your answer is no, give a counterexample. 
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3.49. Let x[n] be a causal stable sequence with z-transform X{z). The complex cepstrum x[n] is 
defined as the inverse transform of the logarithm of X(z); i.e., 

X{z) = \ogX{z)^ x[n], 

where the ROC of X(z) includes the unit circle. (Strictly speaking, taking the logarithm of 
a complex number requires some careful considerations. Furthermore, the logarithm of a 
valid z-transform may not be a valid z-transform. For now, we assume that this operation 
is valid.) 

Determine the complex cepstrum for the sequence /" 

x[n] = 8[n] + a8[n - N], where \a\ < 1. 

3.50. Assume that x[n] is real and even; i.e., x[n] — x[— n\. Further, assume that zo is a zero of 
X( Z ); i.e., A-(zo) = 0. 

(a) Show that 1/zo is also a zero of X(z). 

(b) Are there other zeros of X{z) implied by the information given? 

3.51. Using the definition of the z-transform in Eq. (3.2), show that if X{z) is the z-transform of 
x[n] = x R [n] + jxj[n], then 

(a) x*[n] JU X*(z*) 

(b) x[-n] J^ X(\/z) 

(c) x R [n] J^ \[X(z) + X*{z*)] 

(d) Xl [n]^j,[X( Z )-X+(z*)] 

3.52. Consider a real sequence x[n] that has all the poles and zeros of its z-transform inside the 
unit circle. Determine, in terms of x[n], a real sequence x\ [n] not equal to x[n], but for which 
xi [0] = x[0], \x\ [n]\ = \x[n]\, and the z-transform of x\ [n] has all its poles and zeros inside 
the unit circle. 

3.53. A real finite-duration sequence whose z-transform has no zeros at conjugate reciprocal pair 
locations and no zeros on the unit circle is uniquely specified to within a positive scale factor 
by its Fourier transform phase (Hayes et al., 1980). 

An example of zeros at conjugate reciprocal pair locations is z = a and (tf *) -1 . Even 
though we can generate sequences that do not satisfy the preceding set of conditions, almost 
any sequence of practical interest satisfies the conditions and therefore is uniquely specified 
to within a positive scale factor by the phase of its Fourier transform. 

Consider a sequence x[n] that is real, that is zero outside < n < N — 1, and whose 
z-transform has no zeros at conjugate reciprocal pair locations and no zeros on the unit 
circle. We wish to develop an algorithm that reconstructs cx[n] from <X(e^ a '), the Fourier 
transform phase of x[n], where c is a positive scale factor. 

(a) Specify a set of (N— 1) linear equations, the solution to which will provide the recovery 
of x[n] to within a positive or negative scale factor from tan{<X(e ]a> )}. You do not have 
to prove that the set of (N — 1) linear equations has a unique solution. Further, show 
that if we know<A'(e yw ) rather than just tan{<A'(e y<u )}, the sign of the scale factor 
can also be determined. 

(b) Suppose 
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Using the approach developed in Part (a), demonstrate that cx[n] can be determined 
from<A r (e' a '), where c is a positive scale factor. 

3.54. For a sequence x[n] that is zero for n < 0, use Eq. (3.2) to show that 

lim X(z) = x[0]. 

What is the corresponding theorem if the sequence is zero for n > 0? 

3.55. The aperiodic autocorrelation function for a real-valued stable sequence x[n] is denned as 

Cxx[n]= Yl *[*]*[" + *]■ 

k=—oo 

(a) Show that the z-transform of c xx [n] is 

C xx {z) = X(z)X(z- x ). 

Determine the region of convergence for C xx (z). 

(b) Suppose that x[n] = a n u[n]. Sketch the pole-zero plot for C xx (z), including the region 
of convergence. Also, find c xx [n] by evaluating the inverse z-transform of C xx (z). 

(c) Specify another sequence, x\[n], that is not equal to x[n] in Part (b), but that has the 
same autocorrelation function, c^j/i], as x[n] in Part (b). 

(d) Specify a third sequence, X2[n], that is not equal to x[n] or X[ [n] y but that has the same 
autocorrelation function as x[n] in Part (b). 

3.56. Determine whether or not the function X{z) = z* can correspond to the z-transform of a 
sequence. Clearly explain your reasoning. 

3.57. Let X{z) denote a ratio of polynomials in z ; i.e., 

B{z) 



X{z) = 



A(z) 



Show that if X(z) has a first-order pole at z = Zo, then the residue of X(z) at z = Zo is 
equal to 

B(z ) 

A f (zoY 

where A'(zq) denotes the derivative of A(z) evaluated at z = zo- 
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Sampling of 
continuous -time signals 



4.0 INTRODUCTION 

Discrete-time signals can arise in many ways, but they most commonly occur as repre- 
sentations of sampled continuous-time signals. It is remarkable that under reasonable 
constraints, a continuous-time signal can be quite accurately represented by samples 
taken at discrete points in time. In this chapter we discuss the process of periodic sam- 
pling in some detail, including the phenomenon of aliasing, which occurs when the 
signal is not bandlimited or when the sampling rate is too low. Of particular impor- 
tance is the fact that continuous-time signal processing can be implemented through a 
process of sampling, discrete-time processing, and the subsequent reconstruction of a 
continuous-time signal. 



4.1 PERIODIC SAMPLING 

Although other possibilities exist (see Steiglitz, 1965; Oppenheim and Johnson, 1972), 
the typical method of obtaining a discrete-time representation of a continuous-time 
signal is through periodic sampling, wherein a sequence of samples, x[n], is obtained 
from a continuous-time signal x c (t) according to the relation 

x[n] = x c (nT), — oo < n < oo. (4.1) 

In Eq. (4.1), T is the sampling period, and its reciprocal, f s = l/7\ is the sampling 
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C/D 



x\n\=x(nT) Fi 9 ure 4 -" 1 Block diagram 
c representation of an ideal 

continuous-to-discrete-time (C/D) 
converter. 



frequency, in samples per second. We also express the sampling frequency as Q s = 2tt/ T 
when we want to use frequencies in radians per second. 

We refer to a system that implements the operation of Eq. (4.1) as an ideal 
continuous-to-discrete-time (C/D) converter, and we depict it in block diagram form 
as indicated in Figure 4.1. As an example of the relationship between x c (t) and x[n], 
in Figure 2.2 we illustrated a continuous-time speech waveform and the corresponding 
sequence of samples. 

In a practical setting, the operation of sampling is implemented by an analog-to- 
digital (A/D) converter. Such systems can be viewed as approximations to the ideal 
C/D converter. Important considerations in the implementation or choice of an A/D 
converter include quantization of the output samples, linearity of quantization steps, 
the need for sample-and-hold circuits, and limitations on the sampling rate. The effects 
of quantization are discussed in Sections 4.8.2 and 4.8.3. Other practical issues of A/D 
conversion are electronic circuit concerns that are outside the scope of this text. 

The sampling operation is generally not invertible; i.e., given the output x[n], 
it is not possible in general to reconstruct x c (t), the input to the sampler, since many 
continuous-time signals can produce the same output sequence of samples. The inherent 
ambiguity in sampling is a fundamental issue in signal processing. Fortunately, it is 
possible to remove the ambiguity by restricting the input signals that go into the sampler. 

It is convenient to represent the sampling process mathematically in the two stages 
depicted in Figure 4.2(a). The stages consist of an impulse train modulator followed 
by conversion of the impulse train to a sequence. Figure 4.2(b) shows a continuous- 
time signal x c (t) and the results of impulse train sampling for two different sampling 
rates. Figure 4.2(c) depicts the corresponding output sequences. The essential difference 
between x s (t) and x[n] is that x s (t) is, in a sense, a continuous-time signal (specifically, 
an impulse train) that is zero except at integer multiples of T. The sequence x[n], on 
the other hand, is indexed on the integer variable n, which in effect introduces a time 
normalization; i.e., the sequence of numbers x[n] contains no explicit information about 
the sampling rate. Furthermore, the samples of x c (t) are represented by finite numbers 
in x[n] rather than as the areas of impulses, as with x 5 (t). 

It is important to emphasize that Figure 4.2(a) is strictly a mathematical represen- 
tation that is convenient for gaining insight into sampling in both the time domain and 
frequency domain. It is not a close representation of any physical circuits or systems 
designed to implement the sampling operation. Whether a piece of hardware can be 
construed to be an approximation to the block diagram of Figure 4.2(a) is a secondary 
issue at this point. We have introduced this representation of the sampling operation 
because it leads to a simple derivation of a key result and because the approach leads to 
a number of important insights that are difficult to obtain from a more formal derivation 
based on manipulation of Fourier transform formulas. 
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Figure 4.2 Sampling with a periodic impulse train followed by conversion to 
a discrete-time sequence, (a) Overall system, (b) x s {t) for two sampling rates, 
(c) The output sequence for the two different sampling rates. 



4.2 FREQUENCY-DOMAIN REPRESENTATION OF SAMPLING 

To derive the frequency-domain relation between the input and output of an ideal C/D 
converter, let us first consider the conversion of x c (t) to x s (t) through modulation of 
the periodic impulse train 



5(r)= J2 S(t-nT). 



(4.2) 



where S(t) is the unit impulse function, or Dirac delta function. We modulate s(t) with 
x c (t), obtaining 



x s (t) =x c (t)s(t) 

= x c (t) Y, S('-nT). 



(4.3) 
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Through the "sifting property" of the impulse function, x s (t) can be expressed as 

x s (t) = ]T x c (nT)8(t-nT). (4.4) 

11= oc 

Let us now consider the Fourier transform of x s (t). Since, from Eq. (4.3), x s (t) is 
the product of x c (t) and s(t), the Fourier transform of x s (t) is the convolution of the 
Fourier transforms X c (jQ) and S(jQ). The Fourier transform of a periodic impulse 
train is a periodic impulse train (Oppenheim and Willsky. 1997). Specifically, 

S(jQ)= 2 ^r Yl W-kns). (4.5) 

A: — — oc 

where Q s = 2tz/ T is the sampling frequency in radians/s. Since 

x s (jn) = ^-x c (jn)*s(jn), 

LIT 

where * denotes the operation of continuous-variable convolution, it follows that 

1 
T 



Xs(jSl) = i ]T X c (j(Q - kQ s )). (4.6) 

k=-cc 



Equation (4.6) provides the relationship between the Fourier transforms of the in- 
put and the output of the impulse train modulator in Figure 4.2(a). We see from Eq. (4.6) 
that the Fourier transform of jc iV (t) consists of periodically repeated copies of the Fourier 
transform of x c (t). The copies of X c (jQ) are shifted by integer multiples of the sam- 
pling frequency and then superimposed to produce the periodic Fourier transform of 
the impulse train of samples. Figure 4.3 depicts the frequency-domain representation of 
impulse train sampling. Figure 4.3(a) represents a bandlimited Fourier transform whose 
highest nonzero frequency component in X c (jQ) is at Q^. Figure 4.3(b) shows the pe- 
riodic impulse train S(jQ), and Figure 4.3(c) shows X s (jQ), the result of convolving 
X c (jQ) with S(j£2). From Figure 4.3(c), it is evident that when 

Q s — Qn > Qn, or Q s > 2Q. N , (4.7) 

the replicas of X c (jQ) do not overlap, and therefore, when they are added together in 
Eq. (4.6), there remains (to within a scale factor of \/T) a replica of X c (jQ) at each 
integer multiple of Q s . Consequently, x c (t) can be recovered from x s (t) with an ideal 
lowpass filter. This is depicted in Figure 4.4(a), which shows the impulse train modu- 
lator followed by a linear time-invariant system with frequency response H r (jQ). For 
X c (jQ) as in Figure 4.4(b), X s (jQ) would be as shown in Figure 4.4(c), where it is 
assumed that Q s > 2^. Since 

X r (jQ) = H r (jQ)X s (jQ), (4.8) 

it follows that if H r (jQ) is an ideal lowpass filter with gain T and cutoff frequency Q c 
such that 

Q N < Q c < (Q s - & N ), (4.9) 

then 

X r (jQ) = X c (jQ), (4.10) 

as depicted in Figure 4.4(e). 
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domain of sampling in the time domain. 

(a) Spectrum of the original signal. 

(b) Spectrum of the sampling function. 

(c) Spectrum of the sampled signal with 
Q s > 2Q.fi- (d) Spectrum of the 
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If the inequality of Eq. (4.7) does not hold, i.e., if Q s < 2Q^, the copies of X c (jQ) 
overlap, so that when they are added together, X c (jQ,) is no longer recoverable by 
lowpass filtering. This is illustrated in Figure 4.3(d). In this case, the reconstructed 
output x r (t) in Figure 4.4(a) is related to the original continuous-time input through 
a distortion referred to as aliasing distortion, or simply, aliasing. Figure 4.5 illustrates 
aliasing in the frequency domain for the simple case of a cosine signal. Figure 4.5(a) 
shows the Fourier transform of the signal 



x c (t) = cos£2q'- 



(4.11) 



Figure 4.5(b) shows the Fourier transform of x s (t) with Q Q < Q s /2, and Figure 4.5(c) 
shows the Fourier transform of x s (t) with Q > & s /2. Figures 4.5(d) and (e) correspond 
to the Fourier transform of the lowpass filter output for Q < Q s /2 = tt/T and Qq > 
Ti IT, respectively, with £2 C = Q s /2. Figures 4.5(c) and (e) correspond to the case of 
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Figure 4.4 Exact recovery of a 
continuous-time signal from its samples 
using an ideal lowpass filter. 



aliasing. With no aliasing (Figures 4.5(b) and (d)), the reconstructed output is 

x r (t) = cos£V- (4.12) 

With aliasing, the reconstructed output is 

x r (t) = cos(Q, - Q Q )t; (4.13) 

i.e., the higher frequency signal cos QqC nas taken on the identity (alias) of the lower 
frequency signal cos(Q 5 — Qo)t as a consequence of the sampling and reconstruction. 
This discussion is the basis for the Nyquist sampling theorem (Nyquist 1928; Shannon, 
1949), stated as follows. 
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Nyquist Sampling Theorem: Let x L (f ) be a bandlimited signal with 

X c (jQ) = for \Q\ > Q N . (4.14a) 
Then x c (t) is uniquely determined by its samples x[n] = x c (nT), n ~ 0, ±1, ±2 if 

Q s = — > 2Q N . (4.14b) 

The frequency Q^ is commonly referred to as the Nyquist frequency, and the frequency 
2Q N that must be exceeded by the sampling frequency is called the Nyquist rate. 

Thus far, we have considered only the impulse train modulator in Figure 4.2(a). 
Our eventual objective is to express X(e^), the discrete-time Fourier transform of the 
sequence x[n], in terms of X s (jQ) and X c (j Q). To this end, let us consider an alternative 
expression for X s (jQ). Applying the continuous-time Fourier transform to Eq. (4.4), 
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we obtain 

X s (jQ) = Y, Xc(nT)e-i nTn . (4.15) 

n= — oc 

Since 

x[n] = x c (nT) (4.16) 

and 

X(e JM )= Y x W e ~ iQ "'' ( 4 - 17 ) 

n = — oc 

it follows that 

^(/fi) = *(e''")L =n7 - = *(<? yn7 ')- (4.18) 

Consequently, from Eqs. (4.6) and (4.18), 

X(e ,aT ) = ^ E X '(H a -*«»))• ( 4 - 19 > 



A." = — oc 



or equivalently, 



^-iE^f/ft-^). < 4 - 2 °) 



£= — oc 



From Eqs. (4.18)-(4.20), we see that X(e ji0 ) is simply a frequency-scaled version of 
A"i-(yfi) with the frequency scaling specified by a> = QT. This scaling can alternatively 
be thought of as a normalization of the frequency axis so that the frequency Q = Q s in 
X s (jQ) is normalized to co — 2n for X(e jClJ ). The fact that there is a frequency scaling 
or normalization in the transformation from X s (jQ) to X(e Jl °) is directly associated 
with the fact that there is a time normalization in the transformation from x s (t) to x[ri\. 
Specifically, as we see in Figure 4.2, x s (t) retains a spacing between samples equal to the 
sampling period T. In contrast, the "spacing" of sequence values x[n] is always unity; 
i.e., the time axis is normalized by a factor of T. Correspondingly, in the frequency 
domain the frequency axis is normalized by a factor of f s = 1/7. 

Example 4.1 Sampling and Reconstruction 
of a Sinusoidal Signal 

If we sample the continuous-time signal x c (t) = cos^OOOtt/ 1 ) with sampling period 
T = 1/6000, we obtain x[rt] = x c (nT) = cos(40007r Tri) — cos(<w<)«). where coq = 
4000^ T = 2tt/3. In this case, Q s = In j T = 12000jt. and the highest frequency of the 
signal is Qo = 4000tt, so the conditions of the Nyquist sampling theorem are satisfied 
and there is no aliasing. The Fourier transform of x L (t) is 

X c (jQ) = tt8(£1 - 4000tt) + tt8(Q + 4000tt). 
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Figure 4.6 Continuous-time (a) and discrete-time (b) Fouriertransformsforsam- 
pled cosine signal with frequency Qq = 4000jt and sampling period T = 1 /6000. 



and Figure 4.6(a) shows 



X s {jQ)=- Y, X c {j{Q-kn x )) 



(4.21) 



for Q s - I2,0()()7r. Note that X c (jQ) is a pair of impulses at Q = ±4000tt, and 
we see shifted copies of this Fourier transform centered on ±£V ±2£2 V , etc. Plot- 
ting X{ei 0> ) = X s {jco/T) as a function of the normalized frequency co — QT gives 
Figure 4.6(b), where we have used the fact that scaling the independent variable of 
an impulse also scales its area, i.e., 8{(o/T) = T8(co). Note that the original frequency 
Q {) — 40()()tt corresponds to the normalized frequency coo = 4(XX)7r T = 2jt/3, which 
satisfies the inequality coq < tt, corresponding to the fact that £2o = 40(H) tt < jt/ T — 
6000tt. Figure 4.6(a) also shows the frequency response of the ideal reconstruction 
filter H r (jQ) for the given sampling rate of Q x — 12,000tt. It is clear from this figure 
that the signal that would be reconstructed would have frequency Qo ~ 4000 tt, which 
is the frequency of the original signal x c (t). 



Example 4.2 Aliasing in the Reconstruction 
of an Undersampled Sinusoidal Signal 

Now suppose that the continuous-time signal is x c (t) = cos(16,0(H)7r7 ), but the sam- 
pling period is T — 1 /6000, as it was in Example 4. 1 . This sampling period fails to satisfy 
the Nyquist criterion, since Q s = 2tt/ T = 12.0007T < 2£2o = 32,000tt. Consequently, 
we expect to see aliasing. Now we see an interesting result. The Fourier transform 
X s (jQ) for this case is identical to that of Figure 4.6(a). However, now the impulse 
located at Q = -40007T is from X c (j(Q - Q s )) in Eq. (4.21) rather than from X c (jQ,) 
and the impulse at Q = 4000tt is from X c {j{Q + Q x )). Plotting X(e^") = X s (jco/T) 
as a function of co yields the same graph as shown in Figure 4.6(b), since we are 
normalizing by the same sampling period. The fundamental reason for this is that 
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the sequence of samples is the same in both cases; i.e., 

cos(16,000jt«/6000) = cos(2tt« + 4000tt«/6000) = cos(2jt«/3). 

(Note that we can add any integer multiple of 2n to the argument of the cosine 
without changing its value.) Thus, we have obtained the same sequence of samples, 
x[n] = cos(27rn/3), by sampling two different continuous-time signals with the same 
sampling frequency. In one case the sampling frequency satisfied the Nyquist criterion, 
and in the other case it did not. As before, Figure 4.6(a) shows the frequency response 
of the ideal reconstruction filter H r (jQ) for the given sampling rate of Q s = 12,000^. 
It is clear from this figure that the signal that would be reconstructed would have 
frequency Qq = 4000 tt, which is not the frequency of the original signal x c (t). 



Example 4.3 A Second Example of Aliasing 

As a final example, suppose that the signal is again x c (t) = cos(4000;rf )< as it was in 
Example 4.1; i.e., the frequency is again £2o = 4000jt. However, now the sampling 
period is increased to T = 1/1500. Once more, this sampling period fails to satisfy 
the Nyquist criterion, since Q s — 2tt/T — 3000jt < 2Qq — 8000;t. Consequently, we 
expect to see aliasing again. Figure 4.7(a) shows the plot of X s (jQ) in this case. This 
time the impulse located at £2 = — IOOOjt is from X c (j(Q — Q s )), and the impulse at 
Q = IOOOtt is from X c (j(Q + Q s )). Plotting X{e^°) = X s (jw/T) as a function of 
a) yields the graph shown in Figure 4.7(b), which we see is identical to Figure 4.6(b). 
Again, this Fourier transform corresponds to the sequence x[n] = cos(2jt/i/3). Ac- 
cordingly, we see that the same discrete-time signal may result from sampling the same 
continuous-time signal at two different sampling rates if one of those sampling rates 
fails to satisfy the sampling theorem. The frequency response of the ideal reconstruc- 
tion filter H r (jQ) for the given sampling rate of Q s — 3000jt is shown Figure 4.7(a). 
It is clear from this figure that the signal that would be reconstructed using sampling 
period T = 1/1500 would have frequency Qq = 10007T and not 4000jt. 
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Figure 4.7 Continuous-time (a) and discrete-time (b) Fourier transforms for sam- 
pled cosine signal with frequency £2q = 40007r and sampling period T = 1/1500. 
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4.3 RECONSTRUCTION OF A BANDLIMITED SIGNAL 
FROM ITS SAMPLES 

According to the sampling theorem, samples of a continuous-time bandlimited signal 
taken frequently enough are sufficient to represent the signal exactly, in the sense that 
the signal can be recovered from the samples and with knowledge of the sampling 
period. Impulse train modulation provides a convenient means for understanding the 
process of reconstructing the continuous-time bandlimited signal from its samples. 

In Section 4.2 we saw that if the conditions of the sampling theorem are met and if 
the modulated impulse train is filtered by an appropriate lowpass filter, then the Fourier 
transform of the filter output will be identical to the Fourier transform of the original 
continuous-time signal x c (t), and thus, the output of the filter will be x c (t). If we are 
given a sequence of samples, x[n], we can form an impulse train x s (t) in which successive 
impulses are assigned an area equal to successive sequence values, i.e., 

oo 

x s (t)= ^2 x[n]S(t-nT). (4.22) 

n= — oo 

The nth sample is associated with the impulse at t — nT, where T is the sampling 
period associated with the sequence x[n]. If this impulse train is the input to an ideal 
lowpass continuous-time filter with frequency response H r (jQ) and impulse response 
h r (t), then the output of the filter will be 

oc 

x r [t)= Y^ x[n\h r (t-nT). (4.23) 

n= — oo 

A block diagram representation of this signal reconstruction process is shown in Fig- 
ure 4.8(a). Recall that the ideal reconstruction filter has a gain of T (to compensate 
for the factor of 1/7 in Eq. (4.19) or (4.20)) and a cutoff frequency Q c between Q^ 
and Q s — Q N . A convenient and commonly used choice of the cutoff frequency is 
Q c = Q.s/2 — tt/T. This choice is appropriate for any relationship between Q s and 
Qh that avoids aliasing (i.e., so long as S2 5 > 2&n). Figure 4.8(b) shows the frequency 
response of the ideal reconstruction filter. The corresponding impulse response, h r (t), 
is the inverse Fourier transform of H r (jQ), and for cutoff frequency it I T it is given by 

hr(!) = ^in. (4.24) 

7X1 j I 

This impulse response is shown in Figure 4.8(c). From substituting Eq. (4.24) into 
Eq. (4.23), it follows that 

^— ' 7t it — nT)T 

n=—oo • 7 ' 

From the frequency-domain argument of Section 4.2, we saw that if x[n] — x c (nT), 
where X c (jQ) = for |fi| > n/T, then x r (t) is equal to x c (t). It is not immediately 
obvious that this is true by considering Eq. (4.25) alone. However, useful insight is 
gained by looking at that equation more closely. First let us consider the function h r (t) 
given by Eq. (4.24). We note that 

/i r (0) = 1. (4.26a) 
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Figure 4.8 (a) Block diagram of an 
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This follows from l'Hopital's rule. In addition, 

h,(nT) = forn = ±1,±2, .... (4.26b) 

It follows from Eqs. (4.26a) and (4.26b) and Eq. (4.23) that if x[n] = x c (nT), then 

x,(mT) = x c (mT) (4.27) 

for all integer values of m. That is, the signal that is reconstructed by Eq. (4.25) has the 
same values at the sampling times as the original continuous-time signal, independently 
of the sampling period T. 

In Figure 4.9, we show a continuous-time signal x c (t) and the corresponding mod- 
ulated impulse train. Figure 4.9(c) shows several of the terms 

, sin[7r(t -nT)/T] 

x[n] . 

n{t — nT)/T 

and the resulting reconstructed signal x t (t). As suggested by this figure, the ideal lowpass 
filter interpolates between the impulses of x s (t) to construct a continuous-time signal 
x r (t). From Eq. (4.27), the resulting signal is an exact reconstruction of * c (0 at the 
sampling times. The fact that, if there is no aliasing, the lowpass filter interpolates the 
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Figure 4.10 (a) Ideal bandlimited signal reconstruction, (b) Equivalent represen- 
tation as an ideal D/C converter. 



correct reconstruction between the samples follows from our frequency-domain analysis 
of the sampling and reconstruction process. 

It is useful to formalize the preceding discussion by defining an ideal system for 
reconstructing a bandlimited signal from a sequence of samples. We will call this system 
the ideal discrete-to-continuous-time (D/C) converter. The desired system is depicted in 
Figure 4.10. As we have seen, the ideal reconstruction process can be represented as the 
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conversion of the sequence to an impulse train, as in Eq. (4.22), followed by filtering with 
an ideal lowpass filter, resulting in the output given by Eq. (4.25). The intermediate step 
of conversion to an impulse train is a mathematical convenience in deriving Eq. (4.25) 
and in understanding the signal reconstruction process. However, once we are familiar 
with this process, it is useful to define a more compact representation, as depicted in 
Figure 4.10(b), where the input is the sequence x[n] and the output is the continuous- 
time signal x r (t) given by Eq. (4.25). 

The properties of the ideal D/C converter are most easily seen in the frequency 
domain. To derive an input/output relation in this domain, consider the Fourier trans- 
form of Eq. (4.23) or Eq. (4.25), which is 

DC 

X,(ja) = Y, x[n]H r (jQ.)e~> ar ". 



By factoring H r (jQ) out of the sum, we can write 

X r (jQ) = H r (jQ)X(e iaT ). 



(4.28) 



Equation (4.28) provides a frequency-domain description of the ideal D/C converter. 
According to Eq. (4.28), X(e^°) is frequency scaled (i.e., to is replaced by QT). The ideal 
lowpass filter H r (j Q) selects the base period of the resulting periodic Fourier transform 
X(ei QI ) and compensates for the 1/7 scaling inherent in sampling. Thus, if the sequence 
x[n] has been obtained by sampling a bandlimited signal at the Nyquist rate or higher, 
then the reconstructed signal x r (t) will be equal to the original bandlimited signal. In 
any case, it is also clear from Eq. (4.28) that the output of the ideal D/C converter 
is always bandlimited to at most the cutoff frequency of the lowpass filter, which is 
typically taken to be one-half the sampling frequency. 

4.4 DISCRETE-TIME PROCESSING OF CONTINUOUS-TIME SIGNALS 

A major application of discrete-time systems is in the processing of continuous-time sig- 
nals. This is accomplished by a system of the general form depicted in Figure 4.1 1. The 
system is a cascade of a C/D converter, followed by a discrete-time system, followed by 
a D/C converter. The block diagram of Figure 4.11 represents a large class of systems, 
since the sampling rate and the discrete-time system can be chosen as we wish. Note 
that the overall system is equivalent to a continuous-time system, since it transforms 
the continuous-time input signal x c (t) into the continuous-time output signal y r (t)- Th e 
properties of the overall system are dependent on the choice of the discrete-time system 
and the sampling rate. We assume in Figure 4.11 that the C/D and D/C converters have 
the same sampling rate. This is not essential, and later sections of this chapter and some 
of the problems at the end of the chapter consider systems in which the input and output 
sampling rates are not the same. 
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Figure 4.11 Discrete-time processing 
of continuous-time signals. 
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The previous sections of the chapter have been devoted to understanding the 
C/D and D/C conversion operations in Figure 4.11. For convenience, and as a first step 
in understanding the overall system of Figure 4.11, we summarize the mathematical 
representations of these operations. 

The C/D converter produces a discrete-time signal 

x[n] = x c (nT), (4.29) 

i.e., a sequence of samples of the continuous-time input signal x c (t). The discrete-time 
Fourier transform of this sequence is related to the continuous-time Fourier transform 
of the continuous-time input signal by 

^n^txjj^- 2 ^)). (4.30) 

k=-oo ^ ^ ' ' 

The D/C converter creates a continuous-time output signal of the form 

^ _ 1 sin[jr(r - nT)/T] /A ^,, 

n=-oo v " 

where the sequence y[n] is the output of the discrete-time system when the input to the 
system is x[n]. From Eq. (4.28), F r (;£2), the continuous-time Fourier transform of y r (t), 
and Y(e> w ), the discrete-time Fourier transform of y[«], are related by 

Y r UV) = H r (jQ)Y(e>* T ) 

J^ /ar ). |G|<*/7\ (432) 

\ 0, otherwise. ^ 

Next, let us relate the output sequence y[n] to the input sequence x[n], or equiva- 
lent^, Y(ei w ) to X(e' }ai ). A simple example is the identity system, i.e., y[n] — x[n]. This 
is the case that we have studied in detail already. We know that if jc c (r ) has a bandlimited 
Fourier transform such that X c (jQ) = for \Q\ > tt/ T and if the discrete-time system 
in Figure 4.11 is the identity system such that y[n] = x[n] = x c (nT)< then the output will 
be y r (t) — x c (t). Recall that, in proving this result, we utilized the frequency-domain 
representations of the continuous-time and discrete-time signals, since the key concept 
of aliasing is most easily understood in the frequency domain. Likewise, when we deal 
with systems more complicated than the identity system, we generally carry out the 
analysis in the frequency domain. If the discrete-time system is nonlinear or time vary- 
ing, it is usually difficult to obtain a general relationship between the Fourier transforms 
of the input and the output of the system. (In Problem 4.33, we consider an example of 
the system of Figure 4.11 in which the discrete-time system is nonlinear.) However, the 
linear time-invariant case leads to a rather simple and very useful result. 

4.4.1 Linear Time-Invariant Discrete-Time Systems 

If the discrete-time system in Figure 4.11 is linear and time invariant, we then have 

Y{e j( °) = H(e^)X(e j(V ), (4.33) 

where H(e }a) ) is the frequency response of the system or, equivalently, the Fourier 
transform of the unit sample response, and X(e^ 0) ) and Y(e^) are the Fourier transforms 
of the input and output, respectively. Combining Eqs. (4.32) and (4.33), we obtain 

Y r (jQ) = H r (jQ)H(e^ T )X(ei QT ). (4.34) 
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Next, using Eq. (4.30) with co = QT* we have 

Y r (ja) = H r (jQ)H( e > aT A JT X c (j (a - 2 -^X) . (4.35) 



j L^ MM T 

k=—oc ' ' 

If X c (jQ) — for \Q\ > tt/T, then the ideal lowpass reconstruction filter H r (jQ) 
cancels the factor 1/7 and selects only the term in Eq. (4.35) for k = 0; i.e., 

Thus, if X c (jQ) is bandlimited and the sampling rate is above the Nyquist rate, the 
output is related to the input through an equation of the form 

Y r (jQ) = H Qii (jQ)X c (jQl (4.37) 

where 

H <*tJ a >-[o. mi>jr/r. (438) 

That is, the overall continuous-time system is equivalent to a linear time-invariant system 
whose effective frequency response is given by Eq. (4.38). 

It is important to emphasize that the linear and time-invariant behavior of the 
system of Figure 4.11 depends on two factors. First, the discrete-time system must be 
linear and time invariant. Second, the input signal must be bandlimited, and the sampling 
rate must be high enough so that any aliased components are removed by the discrete- 
time system. As a simple illustration of this second condition being violated, consider the 
case when x c (t) is a single unit-amplitude pulse whose duration is less than the sampling 
period. If the pulse is unity at t = 0, then x[n] = <5[n]. However, it is clearly possible 
to shift the pulse so that it is not aligned with any of the sampling times, i.e., x[n] = 
for all n. Obviously, such a pulse, being limited in time, is not bandlimited. Even if the 
discrete-time system is the identity system, such that y[n] = x[n], the overall system will 
not be time invariant. In general, if the discrete-time system in Figure 4.11 is linear and 
time invariant, and if the sampling frequency is above the Nyquist rate associated with 
the bandwidth of the input x c (t), then the overall system will be equivalent to a linear 
time-invariant continuous-time system with an effective frequency response given by 
Eq. (4.38). Furthermore, Eq. (4.38) is valid even if some aliasing occurs in the C/D 
converter, as long as H(e j(i) ) does not pass the aliased components. Example 4.4 is a 
simple illustration of this. 

Example 4.4 Ideal Continuous-Time Lowpass Filtering 
Using a Discrete-Time Lowpass Filter 

Consider Figure 4.11, with the linear time-invariant discrete-time system having fre- 
quency response 

//(*'") =(l' M <ftJ - (439) 

V ' ' 0. U) c < \Q)\ <7T. V ; 
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Figure 4.12 (a) Frequency response of discrete-time system in Figure 4.11. 
(b) Corresponding effective continuous-time frequency response for bandlimited 
inputs. 



This frequency response is, of course, periodic with period 2n, as shown in Fig- 
ure 4.12(a). For bandlimited inputs sampled above the Nyquist rate, it follows from 
Eq. (4.38) that the overall system of Figure 4.1 1 will behave as a linear time-invariant 
continuous-time system with frequency response 



//effO'tt) = 



1, \QT\ < eo v or \Q\ < o) c /T, 
0, \QT\ > o) c or | £2 1 > co c / T. 



(4.40) 



As shown in Figure 4.12(b), this effective frequency response is that of an ideal lowpass 
filter with cutoff frequency Q c = a> c / T 

As an interpretation of this result, consider the graphical illustration given in 
Figure 4.13. Figure 4.13(a) indicates the Fourier transform of a bandlimited signal. 
Figure 4.13(b) shows the Fourier transform of the intermediate modulated impulse 
train, which is identical to X(ei QT ), the discrete-time Fourier transform of the sequence 
of samples evaluated for co — Q T. In Figure 4.1 3(c), the discrete-time Fourier transform 
of the sequence of samples and the frequency response of the discrete-time system 
are both plotted as a function of the normalized discrete-time frequency variable oj. 
Figure 4.13(d) shows Y(e ja) ) = H(e jw )X(e j<0 ), the Fourier transform of the output 
of the discrete-time system. Figure 4.13(e) illustrates the Fourier transform of the 
output of the discrete-time system as a function of the continuous-time frequency £2, 
together with the frequency response of the ideal reconstruction filter H r (j£l) of the 
D/C converter. Finally, Figure 4.13(f) shows the resulting Fourier transform of the 
output of the D/C converter. By comparing Figures 4.13(a) and 4.13(f), we see that 
the system behaves as a linear time-invariant system with frequency response given 
by Eq. (4.40) and plotted in Figure 4.12(b). 
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Figure 4.13 (a) Fourier transform of a bandlimited input signal, (b) Fourier 
transform of sampled input plotted as a function of continuous-time frequency 
Q. (c) Fourier transform X (e jw ) of sequence of samples and frequency response 
Hie 1 ' 10 ) of discrete-time system plotted vs. m. (d) Fourier transform of output of 
discrete-time system, (e) Fourier transform of output of discrete-time system and 
frequency response of ideal reconstruction filter plotted vs. Q. (f) Fourier transform 
of output 
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Several important points are illustrated in Example 4.4. First, note that the ideal 
lowpass discrete-time filter with discrete-time cutoff frequency co c has the effect of an 
ideal lowpass filter with cutoff frequency Q c = co c / T when used in the configuration 
of Figure 4.11. This cutoff frequency depends on both co c and T. In particular, by using 
a fixed discrete-time lowpass filter, but varying the sampling period T, an equivalent 
continuous-time lowpass filter with a variable cutoff frequency can be implemented. 
For example, if T were chosen so that Q^T < co c , then the output of the system of 
Figure 4.11 would be y r (t) = x c (t). Also, as illustrated in Problem 4,25. Eq. (4.40) will 
be valid even if some aliasing is present in Figures 4.13(b) and (c), as long as these 
distorted (aliased) components are eliminated by the filter H(e* io ). In particular, from 
Figure 4.13(c), we see that for no aliasing to be present in the output, we require that 

{lit -Q N T) > oj c , (4.41) 

compared with the Nyquist requirement that 

(2tt -Q n T) > Q N T. (4.42) 

As another example of continuous-time processing using a discrete-time system, let us 
consider the implementation of an ideal differentiator for bandlimited signals. 

Example 4.5 Discrete-Time Implementation of an Ideal 
Continuous-Time Bandlimited Differentiator 

The ideal continuous-time differentiator system is defined by 

ydO = j t Mt)]. (4.43) 

with corresponding frequency response 

H c (jQ) = jQ. (4.44) 

Since we are considering a realization in the form of Figure 4.11, the inputs are re- 
stricted to be bandlimited. For processing bandlimited signals, it is sufficient that 

"-o-°>={i Q - g::;s <«*> 

as depicted in Figure 4.14(a), The corresponding discrete-time system has frequency 
response 

H(en=Y> M<7r ' (4 " 46) 

and is periodic with period 2n. This frequency response is plotted in Figure 4.14(b). 
The corresponding impulse response can be shown to be 

Tin cos Tin — sin nn 

h[n\ = = . — oo < n < oo, 

7in l T 

or equivalently, 

0, n = 0, 

h[n] = { cos jt /i (4.47) 

nl 
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Figure 4.14 (a) Frequency response of a continuous-time ideal bandlimited dif- 
ferentiator H c {jQ) = /S2, |£2| < tt/ 7". (b) Frequency response of a discrete-time 
filter to implement a continuous-time bandlimited differentiator. 



Thus, if a discrete-time system with this impulse response was used in the config- 
uration of Figure 4.11, the output for every bandlimited input would be the derivative 
of the input. 



Example 4.6 Illustration of Example 4.5 
with a Sinusoidal Input 

Suppose that the bandlimited differentiator of Example 4.5 has input x c (t) 
cos(£2o0 with Qq < x/ T. The sampled input will be x[n] = cos(a>on), where coq 
QqT < tt , and the discrete-time Fourier transform, expressed as a function of Q., is 

1 x 
X(e jQT ) = - ^ [*&(& - £2o -kn s ) + tt8(Q + Q(, - kQ s )]. 

k=—oo 
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If we focus on the base band of frequencies — n/ T < Q < iz j T, we obtain 

X(e jQT ) = -8(Q-Q ) + ^S(n + n ) for\Q\ <tz/T. (4.48) 

To express the discrete-time Fourier transform in terms of oj, we substitute Q — co/T 
into Eq. (4.48) and use the fact that 8(a>/T) - TS(co). The result is 

X{e Sw ) - tz8{co - co {) ) + iz8{co + w ), \a>\ < n. 

The discrete-time Fourier transform X{e^ 0J ) repeats periodically, of course, with pe- 
riod 2n in the variable oj, and X(e^ T ) repeats periodically with period 2k/ T. Now, 
from Eq. (4.46), the discrete-time Fourier transform of the output is 

Y(e j< °) = H(e JM )X(e jco ) 

= — [7tS(0) - COo) + Tt8(a) + (*)[))] 



— — d{CO — (Oq) — — 0((D + CO{)), 



\a>\ < 7i. 



From Eq. (4.32), the continuous-time Fourier transform of the output of the D/C 
converter is, for \Q.\ <iz/ T, 

Y r (jQ) = H r (j£l)Y(e iQT ) = TY(e> QT ) 



= T 



JOJQJZ 1 , x }OJt)7l 1 ,„ „ , 

-8(Q - Qq) - ^— —5(^2 + Q ) 



= jQqtt8(Q - J2 ) - J^u7t8(Q + Q ). 
Thus, the reconstruction filter selects the two impulses at ±Qq, so it follows that 

y r {t) = jto^e'**' - jQo^e-^' = -a Q sm(Q t), 
and we obtain the expected result that 



yr(t)=J t [Xc(t)]. 



4.4.2 Impulse Invariance 

We have shown that the cascade system of Figure 4.1 1 can be equivalent to a linear time- 
invariant system for bandlimited input signals. Let us now assume that, as depicted in 
Figure 4.15, we are given a desired continuous-time system that we wish to implement 
in the form of Figure 4.11. With H c (jQ) bandlimited, Eq. (4.38) specifies how to choose 
H(e'^) so that H cf f(jQ) = H c (jQ). Specifically, 



H(en = H c Ua>/T), 



\(0\ < 7T, 



(4.49) 
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Figure 4.15 (a) Continuous-time LTI system, (b) Equivalent system for bandlim- 
ited inputs. 



with the further requirement that T be chosen such that 

H c (jQ) = Q. \Q\ >jt/T. 



(4.50) 



Under the constraints of Eqs. (4.49) and (4.50), there is also a straightforward and useful 
relationship between the continuous-time impulse response h c (t) and the discrete-time 
impulse response h[n\. In particular, as we shall verify shortly, 



h[n] = Th c (nT)\ 



(4.51) 



i.e., the impulse response of the discrete-time system is a scaled, sampled version of 
h ( (t). When h[n] and h c (t) are related through Eq. (4.51), the discrete-time system is 
said to be an impulse-invariant version of the continuous-time system. 

Equation (4.51) is a direct consequence of the discussion in Section 4.2. Specifically, 
with x[n\ and x c (t) respectively replaced by h[n] and h c (t) in Eq. (4.16), i.e., 



h[n\=h c {nT\ 



Eq. (4.20) becomes 



¥")='E4'-r 



k=-oo 



co 2jzk 



or, if Eq. (4.50) is satisfied, 



//(,>») = i// c (,^ 



M < jr. 



(4.52) 



(4.53) 



(4.54) 



Modifying Eqs. (4.52) and (4.54) to account for the scale factor of T in Eq. (4.51), we 
have 



h[n] = Th c (nT), 



(4.55) 
(4.56) 
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Example 4.7 A Discrete-Time Lowpass Filter Obtained By 
Impulse Invariance 

Suppose that we wish to obtain an ideal lowpass discrete -time filter with cutoff fre- 
quency oj c < n. We can do this by sampling a continuous-time ideal lowpass filter with 
cutoff frequency Q c = a> c / T < tx/T defined by 



fl, \Q\ <Q C , 



The impulse response of this continuous-time system is 

sin(£V) 

M0 = — . 

7Xt 

so we define the impulse response of the discrete-time system to be 

,sin(Q c nT) sin(oj r /i) 



h[n] = Th c (nT) = T 



nnT nn 



where a) c = Q C T. We have already shown that this sequence corresponds to the 
discrete-time Fourier transform 

V ' 10, (D c < \ti)\ < 7X, 

which is identical to H c (ja)/ T), as predicted by Eq. (4.56). 



Example 4.8 Impulse Invariance Applied 
to Continuous-Time Systems with Rational 
System Functions 

Many continuous-time systems have impulse responses composed of a sum of expo- 
nential sequences of the form 

h c {t) = Ae so 'u(t). 

Such time functions have Laplace transforms 

H c (s) = 



S -S() 



If we apply the impulse invariance concept to such a continuous-time system, we obtain 
the impulse response 

h[n] = Th c (nT) = Ae^ Tn u[n], 



which has z-transform system 


function 
H(z) = 




AT 






1- 


- e soT z - 


-l 


and frequency response 


H{e i(0 ) = 




AT 






1- 


- e S{)T e~ 


-j(0 



In this case, Eq. (4.56) does not hold exactly, because the original continuous-time 
system did not have a strictly bandlimited frequency response, and therefore, the re- 
sulting discrete-time frequency response is an aliased version of H c (jQ). Even though 
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aliasing occurs in such a case as this, the effect may be small. Higher order systems 
whose impulse responses are sums of complex exponentials may in fact have fre- 
quency responses that fall off rapidly at high frequencies, so that aliasing is minimal if 
the sampling rate is high enough. Thus, one approach to the discrete-time simulation 
of continuous-time systems and also to the design of digital niters is through sampling 
of the impulse response of a corresponding analog filter. 



4.5 CONTINUOUS-TIME PROCESSING OF DISCRETE-TIME SIGNALS 



In Section 4.4, we discussed and analyzed the use of discrete-time systems for processing 
continuous-time signals in the configuration of Figure 4.11. In this section we consider 
the complementary situation depicted in Figure 4.16, which is appropriately referred to 
as continuous-time processing of discrete-time signals. While the system of Figure 4.16 is 
not typically used to implement discrete-time systems, it provides a useful interpretation 
of certain discrete-time systems. 

From the definition of the ideal D/C converter, X c (jQ) and therefore also Y c (jQ), 
will necessarily be zero for \Q\ > n/ T. Thus, the C/D converter samples y c (t) without 
aliasing, and we can express x c (t) and y c (t) respectively as 



and 



*c(t) = Y^ x ^ 



y c (t) = Y, yW 



sm[7z(t -nT)/T] 
7z(t -nT)/T 

sin[7i(t -nT)/T] 

7i(t-nT)jT ' 



(4.57) 



(4.58) 



where x[n\ = x c (nT) and y[n] = y c (nT). The frequency-domain relationships for 
Figure 4.16 are 

X c (jQ) = TX(e* aT ), |fl| < tt/T, (4.59a) 



Y c (jQ) = H c (jQ)X c (jQ\ 



Y(en = jYc(jY 



|fl| <7T/T, 



\CO\ < 71. 



(4.59b) 
(4.59c) 



Therefore, by substituting Eqs. (4.59a) and (4.59b) into Eq. (4.59c), it follows that the 
overall system behaves as a discrete-time system whose frequency response is 



H(e"") = H c [j- 



CO 



\0)\ < JT, 



(4.60) 
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Figure 4.16 Continuous-time 
processing of discrete-time signals. 
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or equivalently, the overall frequency response of the system in Figure 4. 16 will be equal 
to a given H(e' (0 ) if the frequency response of the continuous-time system is 



H c (jQ) = H(e jQT ), \Q\ < it IT. 



(4.61) 



Since X c (jQ) = for \Q\ > tt/T, H c (jQ) may be chosen arbitrarily above n/T. A 
convenient, but arbitrary, choice is H c (jQ) = for |Q| > nj T. 

With this representation of a discrete-time system, we can focus on the equivalent 
effect of the continuous-time system on the bandlimited continuous-time signal x c (t). 
This is illustrated in Examples 4.9 and 4.10. 

Example 4.9 Noninteger Delay 



Let us consider a discrete-time system with frequency response 



H(e jl ") = e~ i( " A . 



\0)\ < 7T. 



(4.62) 



When A is an integer, this system has a straightforward interpretation as a delay 
of A, i.e., 

y [n] = x[n - A]. (4.63) 

When A is not an integer, Eq. (4.63) has no formal meaning, because we cannot shift 
the sequence x[n\ by anything but an integer. However, with the use of the system of 
Figure 4.16, a useful time-domain interpretation can be applied to the system specified 
by Eq. (4.62). Let H t -(j£l) in Figure 4.16 be chosen to be 



H t .(jQ)= H(e iQT ) = e-* il * T . 



(4.64) 



Then, from Eq. (4.61), the overall discrete-time system in Figure 4.16 will have the 
frequency response given by Eq. (4.62), whether or not A is an integer. To interpret 
the system ofEq. (4.62), we note that Eq. (4.64) represents a time delay of AT seconds. 
Therefore. 

yAt) = x c (t-AT). (4.65) 

Furthermore, .v c -(0 is the bandlimited interpolation of x[n], and y[n\ is obtained by 
sampling y c (t). For example, if A = if, y[n] would be the values of the bandlimited 
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Figure 4.17 Continuous-time processing of the discrete-time sequence in part 
(a) can produce a new sequence with a "half-sample" delay, as in part (b). 
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interpolation halfway between the input sequence values. This is illustrated in Fig- 
ure 4.17. We can also obtain a direct convolution representation for the system defined 
by Eq. (4.62). From Eqs. (4.65) and (4.57), we obtain 



y[n] = y c (nT) = x c (nT-AT) 

sin[jr(r- AT-kT)/T] 
7i(t - AT-kT)/T 



= E *w 



(4.66) 



k=— co 

CO 



\r = nT 



Esinjr(« — k — A) 
m n(n-k-A) 

k=-oc 

which is, by definition, the convolution of x[n] with 

sin7r(n - A) 



*M = 



jr(n-A) 



— oo < n < oo. 



When A is not an integer, h[n] has infinite extent. However, when A = ^o is an integer, 
it is easily shown that h[n] — <5[n— /?o], which is the impulse response of the ideal integer 
delay system. 

The noninteger delay represented by Eq. (4.66) has considerable practical sig- 
nificance, since such a factor often arises in the frequency-domain representation of 
systems. When this kind of term is found in the frequency response of a causal discrete- 
time system, it can be interpreted in the light of this example. This interpretation is 
illustrated in Example 4.10. 



Example 4.10 Moving-Average System 
with Noninteger Delay 

In Example 2.20, we considered the general moving-average system and obtained its 
frequency response. For the case of the causal (M + l)-point moving-average system, 
M\ = and M2 = M, and the frequency response is 



H(e^) = 



1 sin[w(A/+l)/2] 



-jwM/2 



(M+l) sm(co/2) 



H{e> w ) 



\CO\ < 71. 



(4.67) 



x[n] 



1 sin(<y(M + l)/2) 



M+l sin(o)/2) 



wftf] 



e -juiMI2 



l_. 



y[n] 



Figure 4.18 The moving-average system represented as a cascade of two 
systems. 

This representation of the frequency response suggests the interpretation of the 
(M + l)-point moving-average system as the cascade of two systems, as indicated 
in Figure 4.18. The first system imposes a frequency-domain amplitude weighting. The 
second system represents the linear-phase term in Eq. (4.67). If M is an even integer 
(meaning the moving average of an odd number of samples), then the linear-phase 
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term corresponds to an integer delay, i.e., 



y[n] — w[n — M/2]. 



(4.68) 



However, if Mis odd, the linear-phase term corresponds to a noninteger delay, specifi- 
cally, an integer-plus-one-half sample interval. This noninteger delay can be interpreted 
in terms of the discussion in Example 4.9; i.e., y[n] is equivalent to bandlimited interpo- 
lation of w[n], followed by a continuous-time delay of MT/2 (where Tis the assumed, 
but arbitrary, sampling period associated with the D/C interpolation of w [«]), followed 
by C/D conversion again with sampling period T. This fractional delay is illustrated in 
Figure 4.19. Figure 4.19(a) shows a discrete-time sequence x[n] = cos(0.25^/i). This 




(b) 

Figure 4.19 Illustration of moving-average filtering, (a) Input signal x[n] = 
cos(0.25^n). (b) Corresponding output of six-point moving-average filter. 

sequence is the input to a six-point ( M — 5) moving-average filter. In this example, the 
input is "turned on" far enough in the past so that the output consists only of the steady- 
state response for the time interval shown. Figure 4.19(b) shows the corresponding 
output sequence, which is given by 

y[n] = H(e j0 - 25jI )-e j() - 257:n + H(e- jQ - 257T )-e- j() - 257Tn 

= 1 sin[3(0.25^)] /(02Sjr)S/2 . 0-25ir „ 1 sin[3(-0.25^)] . (0-25g)5/2 U25jrfl 
2 6sin(0.1257r) 2 6sin(-0.125jr) 

= 0.308cos[0.25jr(n-2.5)]. 

Thus, the six-point moving-average filter reduces the amplitude of the cosine signal 
and introduces a phase shift that corresponds to 2.5 samples of delay. This is readily 
apparent in Figure 4.19, where we have plotted the continuous-time cosines that would 
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be interpolated by the ideal D/C converter for both the input and the output sequence. 
Note in Figure 4.19(b) that the six-point moving-average filtering gives a sampled 
cosine signal such that the sample points have been shifted by 2.5 samples with respect 
to the sample points of the input. This can be seen from Figure 4.19(b) by comparing 
the positive peak at 10 in the interpolated cosine for the input to the positive peak 
at 12.5 in the interpolated cosine for the output. Thus, the six-point moving-average 
filter is seen to have a delay of 5/2 = 2.5 samples. 

4.6 CHANGING THE SAMPLING RATE USING 
DISCRETE-TIME PROCESSING 

We have seen that a continuous-time signal x< (t) can be represented by a discrete-time 
signal consisting of a sequence of samples 

x[n]=x c (nT). (4.69) 

Alternatively, our previous discussion has shown that, even if x[n] was not obtained 
originally by sampling, we can always use the bandlimited interpolation formula of 
Eq. (4.25) to find a continuous-time bandlimited signal x r (t) whose samples are x[n] = 
x c (nT). 

It is often necessary to change the sampling rate of a discrete-time signal, i.e.. to 
obtain a new discrete-time representation of the underlying continuous-time signal of 
the form 

x'[n] = x c (nT). (4.70) 

where T ^ T. One approach to obtaining the sequences x'[n\ from x[n] is to recon- 
struct x c (t ) from x[n] using Eq. (4.25) and then resample x c (t) with period T to obtain 
x'\n\ Often, however, this is not a desirable approach, because of the nonideal analog 
reconstruction filter, D/A converter, and A/D converter that would be used in a practi- 
cal implementation. Thus, it is of interest to consider methods of changing the sampling 
rate that involve only discrete-time operations. 

4.6.1 Sampling Rate Reduction by an Integer Factor 

The sampling rate of a sequence can be reduced by ''sampling" it, i.e., by defining a new 
sequence 

x d [n] = x[nM] = x c (nMT). (4.71) 

Equation (4.71) defines the system depicted in Figure 4.20, which is called a sampling rate 
compressor (see Crochiere and Rabiner, 1983) or simply a compressor. From Eq. (4.71), 
it is clear that Xd[ri\ is identical to the sequence that would be obtained from x c (t) by 



x[h\ 



\m 



x (i [n]=x[nM] 



Sampling Sampling Figure 4.20 Representation of a 

P eriod T period T = mt compressor or discrete-time sampler. 
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sampling with period V — MT. Furthermore, if X c (jQ) = for |fl| > fijy, then x d [n] 
is an exact representation of x c (t) if ixjT' = tt/(MT) > Q N . That is, the sampling rate 
can be reduced by a factor of M without aliasing if the original sampling rate was at least 
M times the Nyquist rate or if the bandwidth of the sequence is first reduced by a factor 
of M by discrete-time filtering. In general, the operation of reducing the sampling rate 
(including any prefiltering) will be called downsampling. 

As in the case of sampling a continuous-time signal, it is useful to obtain a 
frequency-domain relation between the input and output of the compressor. This time, 
however, it will be a relationship between discrete-time Fourier transforms. Although 
several methods can be used to derive the desired result, we will base our derivation on 
the results already obtained for sampling continuous-time signals. First recall that the 
discrete-time Fourier transform of x[n] = x c (nT) is 



k = — oo ^ ' ' 

Similarly, the discrete-time Fourier transform of Xd[n] — x[nM] = x c (nV) with T = 
MTis 

^n=±±X<(i(^- 2 -^)). (4.73) 

Now, since V — MT, we can write Eq. (4.73) as 

X d {en = if* (j (JL-*!L)). (4.74) 

K } MT r £^ V \MT MT)) v > 

To see the relationship between Eqs. (4.74) and (4.72), note that the summation index r 
in Eq. (4.74) can be expressed as 

r = / + *Af , (4.75) 

where k and / are integers such that — oo < k < oo and < i < M — 1. Clearly, r is still 
an integer ranging from — oo to oo, but now Eq. (4.74) can be expressed as 






a) 2jzk 2jti 



T ^ V V^^ T MT 



(4.76) 



The term inside the square brackets in Eq. (4.76) is recognized from Eq. (4.72) as 

X^™*) = j±j\i{^~ 2 4))- (4-77) 

Thus, we can express Eq. (4.76) as 

Af-l 

M 



- Af-l 

X d (e ji °) = — J2 X(e>W M - 2 * ilM) ). (4.78) 



/=o 



Sec. 4.6 Changing the Sampling Rate Using Discrete-Time Processing 169 

There is a strong analogy between Eqs. (4.72) and (4.78): Equation (4.72) expresses 
the Fourier transform of the sequence of samples, x[n] (with period T), in terms of the 
Fourier transform of the continuous-time signal x c (t)\ Equation (4.78) expresses the 
Fourier transform of the discrete-time sampled sequence x^n] (with sampling period M) 
in terms of the Fourier transform of the sequence x [n]. If we compare Eqs. (4.73) and 
(4.78), we see that X ( {(e^") can be thought of as being composed of either an infinite set 
of copies of Xi (/£2), frequency scaled through co = QT' and shifted by integer multiples 
of 27r/ T (Eq. (4.73)), or M copies of the periodic Fourier transform X(eJ'°), frequency 
scaled by M and shifted by integer multiples of 2tt (Eq. (4.78)). Either interpretation 
makes it clear that X ( i(ei <0 ) is periodic with period 2tt (as are all discrete-time Fourier 
transforms) and that aliasing can be avoided by ensuring that X(e' ( ") is bandlimited, 
i.e., 

X(e' l °) = 0, co N < M < tt, (4.79) 

and 2tt/M > 2co^. 

Downsampling is illustrated in Figure 4.21 . Figure 4.21 (a) shows the Fourier trans- 
form of a bandlimited continuous-time signal, and Figure 4.21(b) shows the Fourier 
transform of the impulse train of samples when the sampling period is T. Figure 4.21 (c) 
shows X(ei (0 ) and is related to Figure 4.21(b) through Eq. (4.18). As we have already 
seen, Figures 4.21(b) and (c) differ only in a scaling of the frequency variable. Fig- 
ure 4.21(d) shows the discrete-time Fourier transform of the downsampled sequence 
when M = 2. We have plotted this Fourier transform as a function of the normalized 
frequency co = QT'. Finally, Figure 4.21(e) shows the discrete-time Fourier transform 
of the downsampled sequence plotted as a function of the continuous-time frequency 
variable Q. Figure 4.21(e) is identical to Figure 4.21(d), except for the scaling of the 
frequency axis through the relation Q = co/T'. 

In this example, 2tt/ T = 4Q N ; i.e., the original sampling rate is exactly twice the 
minimum rate to avoid aliasing. Thus, when the original sampled sequence is down- 
sampled by a factor of M = 2, no aliasing results. If the downsampling factor is more 
than 2 in this case, aliasing will result, as illustrated in Figure 4.22. 

Figure 4.22(a) shows the continuous-time Fourier transform of x ( (i), and Fig- 
ure 4.22(b) shows the discrete-time Fourier transform of the sequence x[n] = x c (nT), 
when 2n/ T = 4Q N . Thus, co N — Q N T = tt/2. Now, if we downsample by a factor of 
M — 3, we obtain the sequence xj[n] = x[3n] = x c (n3T) whose discrete-time Fourier 
transform is plotted in Figure 4.22(c) with normalized frequency co = QT'. Note that 
because Mco^j = 3tt/2, which is greater than tt, aliasing occurs. In general, to avoid 
aliasing in downsampling by a factor of M requires that 

to N M < tt or a^v < tt/M. (4.80) 

If this condition does not hold, aliasing occurs, but it may be tolerable for some appli- 
cations. In other cases, downsampling can be done without aliasing if we are willing to 
reduce the bandwidth of the signal x[n] before downsampling. Thus, if x[n] is filtered 
by an ideal lowpass filter with cutoff frequency tt/M, then the output x[n] can be down- 
sampled without aliasing, as illustrated in Figures 4.22(d), (e), and (f). Note that the 
sequence Xd[ri\ — x[nM] no longer represents the original underlying continuous-time 
signal x c (t)> Rather, x ( i[n] = x c (nT'), where T — MT, and x c (t) is obtained from x r (t) 
by lowpass filtering with cutoff frequency Q c = tt/ V = tt/(MT). 
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Figure 4.21 Frequency-domain illustration of downsampling. 
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Figure 4.22 (a)-(c) Downsampling with aliasing, (d)-(f) Downsampling with 
prefiltering to avoid aliasing. 
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Sampling 
period T 



Lowpass filter 
Gain = 1 

Cutoff = 77 !M 



x[n] 

Sampling 
period T 




x d [n]=x[nM] 



Sampling 
period T' = MT 



Figure 4.23 General system for 
sampling rate reduction by M. 



From the preceding discussion, we see that a general system for downsampling by 
a factor of M is the one shown in Figure 4.23. Such a system is called a decimator, and 
downsampling by lowpass filtering followed by compression has been termed decimation 
(Crochiere and Rabiner, 1983). 

4.6.2 Increasing the Sampling Rate by an Integer Factor 

We have seen that the reduction of the sampling rate of a discrete-time signal by an 
integer factor involves sampling the sequence in a manner analogous to sampling a 
continuous-time signal. Not surprisingly, increasing the sampling rate involves opera- 
tions analogous to D/C conversion. To see this, consider a signal x[n\ whose sampling 
rate we wish to increase by a factor of L. If we consider the underlying continuous-time 
signal x c (t), the objective is to obtain samples 

x i [n] = x c (nT') 1 (4.81) 

where V = T/L, from the sequence of samples 

x[n]=x c (nT). (4.82) 

We will refer to the operation of increasing the sampling rate as upsampling. 
From Eqs. (4.81) and (4.82) it follows that 

Xi[n] = x[n/L] = x c (nT/L), n = 0, ±L, ±2L (4.83) 

Figure 4.24 shows a system for obtaining Xj[n] from x[n] using only discrete-time pro- 
cessing. The system on the left is called a sampling rate expander (see Crochiere and 
Rabiner, 1983) or simply an expander. Its output is 



or equivalently, 



r I - / X i n / L ]> w = °> ±L ' ±2L < 
L ^ — \ 0, otherwise, 

x e [n] = Y^ jc[/c]5[« — kL\. 



(4.84) 



(4.85) 



k=—oo 



The system on the right is a lowpass discrete-time filter with cutoff frequency nf L and 
gain L. This system plays a role similar to the ideal D/C converter in Figure 4.10(b). 
First we create a discrete-time impulse train x e [n\, and then we use a lowpass filter to 
reconstruct the sequence. 

The operation of the system in Figure 4.24 is most easily understood in the fre- 
quency domain. The Fourier transform of x e [n] can be expressed as 



X e (e^) = ]T I J2 *M% - kL ] ) e ~ jw " 

n=-oo \k=—oo / 

= J2 x[k]e- Ja,Lk = X{e' ]wL ). 



(4.86) 



k=— oo 
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Figure 4.24 General system for 
sampling rate increase by L. 



Thus, the Fourier transform of the output of the expander is a frequency-scaled 
version of the Fourier transform of the input; i.e., co is replaced by coL so that co is now 
normalized by 

a) = QT'. (4.87) 

This effect is illustrated in Figure 4.25. Figure 4.25(a) shows a bandlimited continuous- 
time Fourier transform, and Figure 4.25(b) shows the discrete-time Fourier transform of 
the sequence x [n] = x t -(nT), where 7r/ 7 = Q^. Figure 4.25(c) shows X e (e j( ") according 
to Eq. (4.86), with L = 2, and Figure 4.25(e) shows the Fourier transform of the desired 
signal jc,-[ai]. We see that Xj(e^°) can be obtained from X e {e )u> ) by correcting the ampli- 
tude scale from 1/ 7 to 1/7' and by removing all the frequency-scaled images of X c (jQ) 
except at integer multiples of 2jt. For the case depicted in Figure 4.25, this requires a 
lowpass filter with a gain of 2 and cutoff frequency jt/2, as shown in Figure 4.25(d). 
In general, the required gain would be L, since 7(1/7) = [\/(T/L)] = 1/7', and the 
cutoff frequency would be tt/L. 

This example shows that the system of Figure 4.24 does indeed give an output 
satisfying Eq. (4.81) if the input sequence x[n] = x c (nT) was obtained by sampling 
without aliasing. That system is therefore called an interpolator, since it fills in the missing 
samples, and the operation of upsampling is therefore considered to be synonymous 
with interpolation. 

As in the case of the D/C converter, it is possible to obtain an interpolation formula 
for Xj[n] in terms of x[n]. First note that the impulse response of the lowpass filter in 
Figure 4.24 is 

sm(Tin/L) 



ht[n] = 



Using Eq. (4.85), we obtain 



*,[/!]= <T X[k] 



k= — oc 



TxnjL 



sin[7r(/7 — kL)/ L] 
n(n-kL)/L 



(4.88) 



(4.89) 



The impulse response hj[n] has the properties 

/i,-[0] = l, 

h/[n] = 0, n = ±L,±2L, 

Thus, for the ideal lowpass interpolation filter, we have 



(4.90) 



xi[n] = x[n/L] = x c (nT/L) = x c (nV), n = 0, ±L, ±27, . . . , (4.91) 

as desired. The fact that Xj[n] = x c (nT') for all n follows from our frequency-domain 
argument. 

In practice, ideal lowpass filters cannot be implemented exactly, but we will see 
in Chapter 7 that very good approximations can be designed. (Also, see Schafer and 
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Figure 4.25 Frequency-domain illustration of interpolation. 
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Rabiner, 1973, and Oetken et al., 1975.) In some cases, very simple interpolation proce- 
dures are adequate. Since linear interpolation is often used (even though it is generally 
not very accurate), it is worthwhile to examine linear interpolation within the general 
framework that we have just developed. 

Linear interpolation can be accomplished by the system of Figure 4.24 if the filter 
has impulse response 



, r . f 1 — \n\/ L, \n\ < L. ,. __. 

^linM = n Ju~ ■ ( 4 - 92 ) 

1 J [0, otherwise, 

as shown in Figure 4.26 for L = 5. With this filter, the interpolated output will be 

JfiinH= Y, Xe[k]h ]]n [n - k] = J2 x[k]h Vin [n - kL]. (4.93) 

A — — oc k= — oc 

Figure 4.27(a) depicts x e [n] and x\ m [n] for the case L — 5. From this figure, we see that 
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Figure 4.26 Impulse response for 
n linear interpolation. 
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o> Figure 4.27 (a) Illustration of linear 
interpolation by filtering, (b) Frequency 
response of linear interpolator compared 
with ideal lowpass interpolation filter. 



176 Sampling of Continuous-Time Signals Chap. 4 

-*HnM is identical to the sequence obtained by linear interpolation between the samples. 
Note that 

*iin[0] = 1, / ^ 

(4.94) 
h ]m [n] = 0, « = ±L,±2L,..., 

so that 

x\m[n] = x[n/ L] at n = 0, ±L, ±2L, . . . . (4.95) 

The amount of distortion in the intervening samples can be gauged by compar- 
ing the frequency response of the linear interpolator with that of the ideal lowpass 
interpolator for a factor-of-L interpolation. It can be shown (see Problem 4.50) that 



//lin(*n = T 



sm(coL/2) 



L I sin(oj/2) 



(4.96) 



This function is plotted in Figure 4.27(b) for L — 5, together with the ideal lowpass 
interpolation filter. From the figure we see that if the original signal is sampled at the 
Nyquist rate, linear interpolation will not be very good, since the output of the filter 
will contain considerable energy in the band iz/ L < \co\ < iz. However, if the original 
sampling rate is much higher than the Nyquist rate, then the linear interpolator will 
be more successful in removing the frequency-scaled images of X c (jQ) at multiples of 
2n/ L. This is because Hy m (e }co ) is small at these normalized frequencies and at higher 
sampling rates the shifted copies of X c (j Q) are more localized at these frequencies. This 
is intuitively reasonable, since, if the original sampling rate greatly exceeds the Nyquist 
rate, the signal will not vary significantly between samples, and thus, linear interpolation 
should be more accurate for oversampled signals. 

4.6.3 Changing the Sampling Rate by a Noninteger Factor 

We have shown how to increase or decrease the sampling rate of a sequence by an 
integer factor. By combining decimation and interpolation, it is possible to change 
the sampling rate by a noninteger factor. Specifically, consider Figure 4.28(a), which 
shows an interpolator that decreases the sampling period from T to 77 L, followed by 
a decimator that increases the sampling period by M, producing an output sequence 
Xd[n\ that has an effective sampling period of T = TM/L. By choosing L and M 
appropriately, we can approach arbitrarily close to any desired ratio of sampling periods. 
For example, if L = 100andA/= 101, then T = 1.017. 

If M > L, there is a net increase in the sampling period (a decrease in the sampling 
rate), and if M < L, the opposite is true. Since the interpolation and decimation filters in 
Figure 4.28(a) are in cascade, they can be combined as shown in Figure 4.28(b) into one 
lowpass filter with gain L and cutoff equal to the minimum of n/L and jt/M. If M > L, 
then iz jM is the dominant cutoff frequency, and there is a net reduction in sampling 
rate. As pointed out in Section 4.6.1, if x[n] was obtained by sampling at the Nyquist 
rate, the sequence Xd[n] will be a lowpass-filtered version of the original underlying 
bandlimited signal if we are to avoid aliasing. On the other hand, if M < L, then tt/L'is 
the dominant cutoff frequency, and there will be no need to further limit the bandwidth 
of the signal below the original Nyquist frequency. 
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Figure 4.28 (a) System for changing the sampling rate by a noninteger factor, (b) 
Simplified system in which the decimation and interpolation filters are combined. 



Example 4.1 1 Sampling Rate Conversion by 
a Noninteger Rational Factor 

Figure 4.29 illustrates sampling rate conversion by a rational factor. Suppose that a 
bandlimited signal with X c (jQ) as given in Figure 4.29(a) is sampled at the Nyquist 
rate; i.e., 2tt / T — 2£2/v. The resulting discrete-time Fourier transform 



X(en = i J2 x < 



2nk 



is plotted in Figure 4.29(b). If we wish to change the sampling period to T' — (3/2)7, 
we must first interpolate by a factor L = 2 and then decimate by a factor of M = 3. 
Since this implies a net decrease in sampling rate, and the original signal was sampled 
at the Nyquist rate, we must incorporate additional lowpass filtering in order to avoid 
aliasing. 

Figure 4.29(c) shows the discrete-time Fourier transform of the output of the 
L = 2 upsampler. If we were interested only in interpolating by a factor of 2, we 
could choose the lowpass filter to have a cutoff frequency of a> c = n/2 and a gain 
of L = 2. However, since the output of the filter will be decimated by M = 3, we 
must use a cutoff frequency of (o c = jt/3, but the gain of the filter should still be 
2 as in Figure 4.29(d). The Fourier transform Xi(e' M ) of the output of the lowpass 
filter is shown in Figure 4.29(e). The shaded regions indicate the part of the signal 
spectrum that is removed due to the lower cutoff frequency for the interpolation filter. 
Finally, Figure 4.29(f) shows the discrete-time Fourier transform of the output of the 
downsampler by M = 3. Note that the shaded regions show the aliasing that would 
have occurred if the cutoff frequency of the interpolation lowpass filter had been 7r/2 
instead of tt/3. 
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Figure 4.29 Illustration of changing the sampling rate by a noninteger factor. 
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4.7 MULTIRATE SIGNAL PROCESSING 

As we have seen, it is possible to change the sampling rate of a discrete -time signal by a 
combination of interpolation and decimation. For example, if we want a new sampling 
period of V — 1.01 T, we can first interpolate by L = 100 using a lowpass filter that cuts 
off at o) c = 7T/101 and then decimate by M = 101. These large intermediate changes in 
sampling rate would require large amounts of computation for each output sample if we 
implement the filtering in a straightforward manner at the high intermediate sampling 
rate that is required. Fortunately, it is possible to greatly reduce the amount of compu- 
tation required by taking advantage of some basic techniques in the area of multirate 
signal processing. Multirate techniques refer in general to utilizing upsampling, down- 
sampling, compressors, and expanders in a variety of ways to increase the efficiency 
of signal-processing systems. Besides their use in sampling rate conversion, they are 
exceedingly useful in A/D and D/A systems that exploit oversampling and noise shap- 
ing. Another important class of signal-processing algorithms that relies increasingly on 
multirate techniques is filter banks for the analysis and/or processing of signals. 

Because of their widespread applicability, there is a large body of results on multi- 
rate signal processing. In this section, we will focus on two basic results and show how a 
combination of these results can greatly improve the efficiency of sampling rate conver- 
sion. The first result is concerned with the interchange of filtering and downsampling 
or upsampling operations. The second is the polyphase decomposition. 



4.7.1 Interchange of Filtering and Downsampling/Upsampling 

We will first derive two identities that aid in manipulating and understanding the opera- 
tion of multirate systems. It is straightforward to show that the two systems in Figure 4.30 
are equivalent. To see the equivalence, note that in Figure 4.30(b), 

X h (e Ja) ) = H(e^ M )X{e joJ ), (4.97) 

and from Eq. (4.78), 



1 M-\ 

Y(e jw ) = — ^2 X b (e j{wlM - 2ni/M) ), 

i=0 



(4.98) 



Substituting Eq. (4.97) into Eq. (4.98) gives 



1 A/-1 
(=0 



j(cu/M-2jzi/M) 



)H(e 



j((o — 2ni) 



)• 



(4.99) 
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Figure 4.30 Two equivalent systems 
based on downsampling identities. 
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Since //(<?» 2;r/) ) = H(e^\ Eq. (4.99) reduces to 



M- 



Y(e' w ) = H(eJ M )— V AV {w/M - 2 ^'/w)) 
A/ ^-^ 

i = 



(4.100) 



which corresponds to Figure 4.30(a). 

A similar identity applies to upsampling. Specifically, using Eq. (4.86) in Sec- 
tion 4.6.2, it is also straightforward to show the equivalence of the two systems in 
Figure 4.31. We have, from Eq. (4.86) and Figure 4.31(a), 



(4.101) 



Y(eJ (0 ) = X a (e j( ' ,L ) 

= X(ei" ,L )H(ei" ,L ). 
Since, from Eq. (4.86), 

X b (e jl °) = X(e jloL ), 

it follows that Eq. (4.101) is, equivalently, 

Y(e }M ) = H(e> loL )X b (e jco ), 

which corresponds to Figure 4.31(b). 

In summary, then, we have shown that the operations of linear filtering and down- 
sampling or upsampling can be interchanged if we modify the linear filter. 
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Figure 4.31 Two equivalent systems 
based on upsampling identities. 



4.7.2 Polyphase Decompositions 

The polyphase decomposition of a sequence is obtained by representing it as a super- 
position of M subsequences, each consisting of every A/th value of successively delayed 
versions of the sequence. When this decomposition is applied to a filter impulse re- 
sponse, it can lead to efficient implementation structures for linear filters in several 
contexts. Specifically, consider an impulse response h[n] that we decompose into M 
subsequences hk[n] as follows: 



h k [n] = 



h[n + k], n = integer multiple of M, 

0. otherwise. 



(4.102) 
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By successively delaying these subsequences, we can reconstruct the original impulse 
response h[n]; i.e., 

h[n] = J2h k [n-k] (4.103) 

*=o 
This decomposition can be represented with the block diagram in Figure 4.32. If we 
create a chain of advance elements at the input and a chain of delay elements at the 
output, the block diagram in Figure 4.33 is equivalent to that of Figure 4.32. In the 
decomposition in Figures 4.32 and 4.33, the sequences e^n] are 

e k [n] = h[nM + k] = h k [nM] (4.104) 

and are referred to in general as the polyphase components of h[n]. There are several 
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Figure 4.32 Polyphase decomposition of filter h[n] using components e^n] 
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Figure 4.33 Polyphase decomposition 
of filter h[n] using components e*[/7] 
with chained delays. 
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other ways to derive the polyphase components, and there are other ways to index 
them for notational convenience (Vaidyanathan, 1993), but the definition in Eq. (4.104) 
is adequate for our purpose in this section. 

Figures 4.32 and 4.33 are not realizations of the filter, but they show how the filter 
can be decomposed into M parallel filters. We see this by noting that Figures 4.32 and 
4.33 show that, in the frequency or z-transform domain, the polyphase representation 
corresponds to expressing H(z) as 

M-\ 

H(z) = Y, E ^ M )z k - (4.105) 

jt=o 
Equation (4.105) expresses the system function H(z) as a sum of delayed polyphase 
component filters. For example, from Eq. (4.105), we obtain the filter structure shown 
in Figure 4.34. 
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Figure 4.34 Realization structure 
based on polyphase decomposition of 
h[n]. 



4.7.3 Polyphase Implementation of Decimation Filters 

One of the important applications of the polyphase decomposition is in the implemen- 
tation of filters whose output is then downsampled as indicated in Figure 4.35. 

In the most straightforward implementation of Figure 4.35, the filter computes 
an output sample at each value of n, but then only one of every M output points 
is retained. Intuitively, we might expect that it should be possible to obtain a more 
efficient implementation which does not compute the samples that are thrown away. 

To obtain a more efficient implementation, we can exploit a polyphase decomposi- 
tion of the filter. Specifically, suppose we express h[n] in polyphase form with polyphase 
components 

e k [n] =h[nM + k]. (4.106) 

From Eq. (4.105), 

A/-1 

ff(z) = ££t(z*')z-*. (4.107) 



x[n] 
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\m 



w[n\=y[nM] Figure 4.35 Decimation system. 
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With this decomposition and the fact that downsampling commutes with addition, 
Figure 4.35 can be redrawn as shown in Figure 4.36. Applying the identity in Figure 4.30 
to the system in Figure 4.36, we see that the latter then becomes the system shown in 
Figure 4.37. 

To illustrate the advantage of Figure 4.37 compared with Figure 4.35, suppose 
that the input x[n] is clocked at a rate of 1 sample per unit time and that H(z) is an 
/V-point FIR filter. In the straightforward implementation of Figure 4.35, we require 
N multiplications and (N — 1) additions per unit time. In the system of Figure 4.37, 
each of the filters £*(z) is of length N/M, and their inputs are clocked at a rate of 
1 per M units of time. Consequently, each filter requires jf(jj) multiplications per unit 
time and -jfo ( ^ — 1 ) additions per unit time, and the entire system then requires ( N/ M) 
multiplications and (-^ — 1) + (M— 1) additions per unit time. Thus, we can achieve a 
significant savings for some values of M and N. 
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Figure 4.36 Implementation of 
decimation filter using polyphase 
decomposition. 



Figure 4.37 Implementation of 
decimation filter after applying the 
downsampling identity to the polyphase 
decomposition. 



4.7.4 Polyphase Implementation of Interpolation Filters 

A savings similar to that just discussed for decimation can be achieved by applying 
the polyphase decomposition to systems in which a filter is preceded by an upsampler 
as shown in Figure 4.38. Since only every Lth sample of w[n] is nonzero, the most 
straightforward implementation of Figure 4.38 would involve applying filter coefficients 
to sequence values that are known to be zero. Intuitively, here again we would expect 
that a more efficient implementation was possible. 
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Figure 4.39 Implementation of 
interpolation filter using polyphase 
decomposition. 




Figure 4.40 Implementation of 
interpolation filter after applying the 
upsampling identity to the polyphase 
decomposition. 



To implement the system in Figure 4.38 more efficiently, we again utilize the 
polyphase decomposition of H{z). For example, we can express H(z) as in the form of 
Eq, (4.107) and represent Figure 4.38 as shown in Figure 4.39. Applying the identity in 
Figure 4.31, we can rearrange Figure 4.39 as shown in Figure 4.40. 

To illustrate the advantage of Figure 4.40 compared with Figure 4.38, we note 
that in Figure 4.38 if x[n] is clocked at a rate of 1 sample per unit time, then w[n] is 
clocked at a rate of L samples per unit time. If H{z) is an FIR filter of length N, we then 
require NL multiplications and (NL — 1) additions per unit time. Figure 4.40, on the 
other hand, requires L(N/ L) multiplications and L ( j- — 1) additions per unit time for 
the set of polyphase filters, plus (L — 1) additions, to obtain y[n\. Thus, we again have 
the possibility of significant savings in computation for some values of L and N. 

For both decimation and interpolation, gains in computational efficiency result 
from rearranging the operations so that the filtering is done at the low sampling rate. 
Combinations of interpolation and decimation systems for noninteger rate changes lead 
to significant savings when high intermediate rates are required. 
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4.8 DIGITAL PROCESSING OF ANALOG SIGNALS 

So far, our discussions of the representation of continuous-time signals by discrete-time 
signals have focused on idealized models of periodic sampling and bandlimited interpo- 
lation. We have formalized those discussions in terms of an idealized sampling system 
that we have called the ideal continuous-to-discrete (C/D) converter and an idealized 
bandlimited interpolator system called the ideal discrete-to-continuous (D/C) converter. 
These idealized conversion systems allow us to concentrate on the essential mathemati- 
cal details of the relationship between a bandlimited signal and its samples. For example, 
in Section 4.4 we used the idealized C/D and D/C conversion systems to show that linear 
time-invariant discrete-time systems can be used in the configuration of Figure 4.41(a) 
to implement linear time-invariant continuous-time systems if the input is bandlimited 
and the sampling rate exceeds the Nyquist rate. In a practical setting, continuous-time 
signals are not precisely bandlimited, ideal filters cannot be realized, and the ideal C/D 
and D/C converters can only be approximated by devices that are called analog-to- 
digital (A/D) and digital-to-analog (D/A) converters, respectively. The block diagram 
of Figure 4.41(b) shows a more realistic model for digital processing of continuous-time 
(analog) signals. In this section we will examine some of the considerations introduced 
by each of the components of the system in Figure 4.41(b). 

4.8.1 Prefiltering to Avoid Aliasing 

In processing analog signals using discrete-time systems, it is generally desirable to 
minimize the sampling rate. This is because the amount of arithmetic processing required 
to implement the system is proportional to the number of samples to be processed. 
If the input is not bandlimited or if the Nyquist frequency of the input is too high, 
prefiltering may be necessary. An example of such a situation occurs in processing speech 
signals, where often only the low-frequency band up to about 3-4 kHz is required for 
intelligibility, even though the speech signal may have significant frequency content in 
the 4 kHz to 20 kHz range. Also, even if the signal is naturally bandlimited, wideband 
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Figure 4.41 (a) Discrete-time filtering of continuous-time signals, (b) Digital processing of 
analog signals. 
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additive noise may fill in the higher frequency range, and as a result of sampling, these 
noise components would be aliased into the low-frequency band. If we wish to avoid 
aliasing, the input signal must be forced to be bandlimited to frequencies below one-half 
the desired sampling rate. This can be accomplished by lowpass filtering the continuous- 
time signal prior to C/D conversion, as shown in Figure 4.42. In this context, the lowpass 
filter that precedes the C/D converter is called an antialiasing filter. Ideally, the frequency 
response of the antialiasing filter would be 



tfaa(/0) = 



1, \Q\ < £2 C < tt/T, 
0, \Q\ > Q c . 



(4.108) 



From the discussion of Section 4.4.1, it follows that the overall system, from the output 
of the antialiasing filter x a {t) to the output y r (t), will always behave as a linear time- 
invariant system, since the input to the C/D converter, x a (t), is forced by the antialiasing 
filter to be bandlimited to frequencies below n/ T radians/s. Thus the overall effective 
frequency response of Figure 4.42 will be the product of H aa (jQ) and the effective 
frequency response from x a (t) to v r (/). Combining Eqs. (4.108) and (4.38) gives 



H eit (jQ) = 



0, \Q\ > Q c . 



(4.109) 



Thus, for an ideal lowpass antialiasing filter, the system of Figure 4.42 behaves as a 
linear time-invariant system with frequency response given by Eq. (4.109), even when 
X c (jQ) is not bandlimited. In practice, the frequency response H aa (jQ) cannot be 
ideally bandlimited, but H aa (jQ) can be made small for \Q\ > n/T so that aliasing 
is minimized. In this case, the overall frequency response of the system in Figure 4.42 
should be approximately 

H eff (jQ) * H aa (jQ)H(e^ T ). (4.110) 

To achieve a negligibly small frequency response above n/ T, it would be necessary 
for H aa (jQ) to begin to "roll off," i.e., begin to introduce attenuation, at frequencies 
below tt/T, Equation (4.110) suggests that the roll-off of the antialiasing filter (and 
other linear time-invariant distortions to be discussed later) could be at least partially 
compensated for by taking them into account in the design of the discrete-time system. 
This is illustrated in Problem 4.56. 

The preceding discussion requires sharp-cutoff antialiasing filters. Such sharp- 
cutoff analog filters can be realized using active networks and integrated circuits. How- 
ever, in applications involving powerful, but inexpensive, digital processors, these 
continuous-time filters may account for a major part of the cost of a system for discrete- 
time processing of analog signals. Sharp-cutoff filters are difficult and expensive to im- 
plement, and if the system is to operate with a variable sampling rate, adjustable filters 
would be required. Furthermore, sharp-cutoff analog filters generally have a highly non- 
linear phase response, particularly at the passband edge. Thus, it is desirable for several 
reasons to eliminate the continuous-time filters or simplify the requirements on them. 
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Figure 4.43 Using oversampled A/D conversion to simplify a continuous-time 
antialiasing filter. 

One approach is depicted in Figure 4.43. With £2^ denoting the highest frequency 
component to eventually be retained after the antialiasing filtering is completed, we 
first apply a very simple antialiasing filter that has a gradual cutoff with significant 
attenuation at MQ/y. Next, implement the C/D conversion at a sampling rate much 
higher than 2Q. N , e.g., at 2MQ. N . After that, sampling rate reduction by a factor of M 
that includes sharp antialiasing filtering is implemented in the discrete-time domain. 
Subsequent discrete-time processing can then be done at the low sampling rate to 
minimize computation. 

This use of oversampling followed by sampling rate conversion is illustrated in 
Figure 4.44. Figure 4.44(a) shows the Fourier transform of a signal that occupies the 
band|Q| < Q^, plus the Fourier transform of what might correspond to high-frequency 
"noise" or unwanted components that we eventually want to eliminate with the antialias- 
ing filter. Also shown (dotted line) is the frequency response of an antialiasing filter that 
does not cut off sharply, but gradually falls to zero at frequencies above a frequency 
Q c . Figure 4.44(b) shows the Fourier transform of the output of this filter. If the signal 
x Cf (t) is sampled with period T such that (2n/T — Q c ) > Q^, then the discrete-time 
Fourier transform of the sequence x[n] will be as shown in Figure 4.44(c). Note that the 
"noise" will be aliased, but aliasing will not affect the signal band \a>\ < ao^ — Q^T. 
Now, if T and T' are chosen so that V = MT and rcj T' — Q^, then x[n] can be filtered 
by a sharp-cutoff discrete-time filter (shown idealized in Figure 4.44(c)) with unity gain 
and cutoff frequency tc/M. The output of the discrete-time filter can be downsampled 
by M to obtain the sampled sequence x ( i[n] whose Fourier transform is shown in Fig- 
ure 4.44(d). Thus, all the sharp-cutoff filtering has been done by a discrete-time system, 
and only nominal continuous-time filtering is required. Since discrete-time FIR filters 
can have an exactly linear phase, it is possible using this oversampling approach to im- 
plement antialiasing filtering with virtually no phase distortion. This can be a significant 
advantage in situations where it is critical to preserve not only the frequency spectrum, 
but the waveshape as well. 



4.8.2 Analog-to-Digital (A/D) Conversion 

An ideal C/D converter converts a continuous-time signal into a discrete-time signal, 
where each sample is known with infinite precision. As an approximation to this for 
digital signal processing, the system of Figure 4.45 converts a continuous-time (analog) 
signal into a digital signal, i.e., a sequence of finite-precision or quantized samples. 
The two systems in Figure 4.45 are available as physical devices. The A/D converter 
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Figure 4.44 Use of oversampling followed by decimation in C/D conversion. 
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Figure 4.45 Physical configuration for 
analog-to-digital conversion. 



is a physical device that converts a voltage or current amplitude at its input into a 
binary code representing a quantized amplitude value closest to the amplitude of the 
input. Under the control of an external clock, the A/D converter can be caused to 
start and complete an A/D conversion every T seconds. However, the conversion is not 
instantaneous, and for this reason, a high-performance A/D system typically includes 
a sample-and-hold, as in Figure 4.45. The ideal sample-and-hold system is the system 
whose output is 



*o 



W= J2 x[n]hQ{t-nT), 



(4.111) 
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Figure 4.46 (a) Representation of an 
ideal sample-and-hold. 
(b) Representative input and output 
signals for the sample-and-hold. 



where x[n] = x a (nT) are the ideal samples of x a (t) and h$(t) is the impulse response 
of the zero-order-hold system, i.e., 

"1, < t < 7\ 
0, otherwise. 



MO = 



(4.112) 



If we note that Eq. (4.111) has the equivalent form 

DC 

x„(t) = ho(t)* J2 xAnT)S(t-nT). 



(4.113) 



we see that the ideal sample-and-hold is equivalent to impulse train modulation followed 
by linear filtering with the zero-order-hold system, as depicted in Figure 4.46(a). The 
relationship between the Fourier transform of xo(t) and the Fourier transform of x a (t) 
can be worked out following the style of analysis of Section 4.2, and we will do a similar 
analysis when we discuss the D/A converter. However, the analysis is unnecessary at 
this point, since everything we need to know about the behavior of the system can be 
seen from the time-domain expression. Specifically, the output of the zero-order hold 
is a staircase waveform where the sample values are held constant during the sampling 
period of T seconds. This is illustrated in Figure 4.46(b). Physical sample-and-hold 
circuits are designed to sample x a (t) as nearly instantaneously as possible and to hold the 
sample value as nearly constant as possible until the next sample is taken. The purpose of 
this is to provide the constant input voltage (or current) required by the A/D converter. 
The details of the wide variety of A/D conversion processes and the details of sample- 
and-hold and A/D circuit implementations are outside the scope of this book. Many 
practical issues arise in obtaining a sample-and-hold that samples quickly and holds the 
sample value constant with no decay or "glitches." Likewise, many practical concerns 
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dictate the speed and accuracy of conversion of A/D converter circuits. Such questions 
are considered in Hnatek (1988) and Schmid (1976), and details of the performance 
of specific products are available in manufacturers' specification and data sheets. Our 
concern in this section is the analysis of the quantization effects in A/D conversion. 

Since the purpose of the sample-and-hold in Figure 4.45 is to implement ideal sam- 
pling and to hold the sample value for quantization by the A/D converter, we can repre- 
sent the system of Figure 4.45 by the system of Figure 4.47, where the ideal C/D converter 
represents the sampling performed by the sample-and-hold and, as we will describe later, 
the quantizer and coder together represent the operation of the A/D converter. 

The quantizer is a nonlinear system whose purpose is to transform the input sample 
x[n] into one of a finite set of prescribed values. We represent this operation as 

x[n] = Q(x[n]) (4.114) 

and refer to x[n] as the quantized sample. Quantizers can be defined with either uniform- 
ly or nonuniformly spaced quantization levels; however, when numerical calculations 
are to be done on the samples, the quantization steps usually are uniform. Figure 4.48 
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Figure 4.48 Typical quantizer for A/D conversion. 
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shows a typical uniform quantizer characteristic 1 in which the sample values are rounded 
to the nearest quantization level. 

Several features of Figure 4.48 should be emphasized. First, note that this quan- 
tizer would be appropriate for a signal whose samples are both positive and negative 
(bipolar). If it is known that the input samples are always positive (or negative), then 
a different distribution of the quantization levels would be appropriate. Next, observe 
that the quantizer of Figure 4.48 has an even number of quantization levels. With an 
even number of levels, it is not possible to have a quantization level at zero amplitude 
and also have an equal number of positive and negative quantization levels. Generally, 
the number of quantization levels will be a power of 2, but the number will be much 
greater than eight, so this difference is usually inconsequential. 

Figure 4.48 also depicts coding of the quantization levels. Since there are eight 
quantization levels, we can label them by a binary code of 3 bits. (In general, 2 B+l levels 
can be coded with a (B + l)-bit binary code.) In principle, any assignment of symbols 
can be used, and many binary coding schemes exist, each with its own advantages and 
disadvantages, depending on the application. For example, the right-hand column of 
binary numbers in Figure 4.48 illustrates the offset binary coding scheme, in which the 
binary symbols are assigned in numeric order, starting with the most negative quantiza- 
tion level. However, in digital signal processing, we generally wish to use a binary code 
that permits us to do arithmetic directly with the code words as scaled representations 
of the quantized samples. 

The left-hand column in Figure 4.48 shows an assignment according to the two's 
complement binary number system. This system for representing signed numbers is 
used in most computers and microprocessors; thus, it is perhaps the most convenient 
labeling of the quantization levels. Note, incidentally, that the offset binary code can be 
converted to two's complement code simply by complementing the most significant bit. 

In the two's-complement system, the leftmost, or most significant, bit is considered 
as the sign bit, and we take the remaining bits as representing either binary integers 
or fractions. We will assume the latter; i.e., we assume a binary fraction point between 
the two most significant bits. Then, for the two's-complement interpretation, the binary 
symbols have the following meaning for B = 2: 
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In general, if we have a (B + l)-bit binary two's-complement fraction of the form 

ao a\a2 . . .ab, 
then its value is 

-a 2 u + 0i2 -1 + a 2 2~ 2 H h a B 2~ B . 

! Such quantizers are also called linear quantizers because of the linear progression of quantization 
steps. 



192 



Sampling of Continuous-Time Signals Chap. 4 



Note that the symbol o denotes the "binary point" of the number. The relationship 
between the code words and the quantized signal levels depends on the parameter 
X m in Figure 4.48. In general, this parameter is called the full-scale level of the A/D 
converter. Typical values are 10, 5, or 1 volt. From Figure 4.48, we see that the step size 
of the quantizer would in general be 

Z A m A. m / a i i c\ 

A = 2^T = 2 F ' (4 ' 115) 

The smallest quantization levels (±A) correspond to the least significant bit of the 
binary code word. Furthermore, the numeric relationship between the code words and 
the quantized samples is 

x[n] = X m x B [n], (4.116) 

since we have assumed that x B [n] is a binary number such that — 1 < x B [n] < 1 (for two's 
complement). In this scheme the binary coded samples x B [n] are directly proportional 
to the quantized samples (in two's complement binary), and therefore, they can be used 
as a numeric representation of the amplitude of the samples. Indeed, it is generally 
appropriate to assume that the input signal is normalized, so that the numeric values of 
x[n] and x B [n] are identical and there is no need to distinguish between the quantized 
samples and the binary coded samples. 

Figure 4.49 shows a simple example of quantization and coding of the samples of 
a sine wave using a 3-bit quantizer. The unquantized samples x[n] are illustrated with 



° Quantized samples 
• Unquantized samples 

Output of ideal sample and hold 
— Output of D/A converter 




x B [n\. Oil 

Figure 4.49 Sampling, quantization, coding, and D/A conversion with a 3-bit quantizer. 
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solid dots, and the quantized samples x[n] are illustrated with open circles. Also shown 
is the output of an ideal sample-and-hold. The dotted lines labeled "output of D/A 
converter" will be discussed later. Figure 4,49 shows, in addition, the 3-bit code words 
that represent each sample. Note that, since the analog input x a (t) exceeds the full-scale 
value of the quantizer, some of the positive samples are "clipped." 

Although much of the preceding discussion pertains to two's-complement cod- 
ing of the quantization levels, the basic principles of quantization and coding in A/D 
conversion are the same regardless of the binary code used to represent the samples. 
A more detailed discussion of the binary arithmetic systems used in digital computing 
can be found in texts on computer arithmetic. (See, for example, Knuth. 1 997.) We now 
turn to an analysis of the effects of quantization. Since this analysis does not depend on 
the assignment of binary code words, it will lead to rather general conclusions. 

4.8.3 Analysis of Quantization Errors 

From Figures 4.48 and 4.49, we see that the quantized sample x[n] will generally be dif- 
ferent from the true sample value x[n]. The difference between them is the quantization 
error, defined as 

e[n] = x[n] - x[n]. (4.117) 

For example, for the 3-bit quantizer of Figure 4.48, if A/2 < x[n] < 3A/2,thenx[/i] = A, 
and it follows that 

-A/2 <e[n] < A/2. (4.118) 

In the case of Figure 4.48, Eq. (4.118) holds whenever 

-9A/2 <x[n] <7A/2. (4.119) 

In the general case of a (B + l)-bit quantizer with A given by Eq. (4.115), the quanti- 
zation error satisfies Eq. (4.118) whenever 

{-X m - A/2) < x[n] < (X m - A/2). (4.120) 

If x[n] is outside this range, as it is for the sample at t = in Figure 4.49, then the 
quantization error is larger in magnitude than A/2, and such samples are said to be 
clipped, 

A simplified, but useful, model of the quantizer is depicted in Figure 4.50. In this 
model, the quantization error samples are thought of as an additive noise signal. The 
model is exactly equivalent to the quantizer if we know e[n]. In most cases, however, 
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Figure 4.50 Additive noise model for 
e \?i\ quantizer. 
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e[n] is not known, and a statistical model based on Figure 4.50 is then often useful in 
representing the effects of quantization. We will also use such a model in Chapters 6 and 
9 to describe the effects of quantization in signal-processing algorithms. The statistical 
representation of quantization errors is based on the following assumptions: 

1. The error sequence e[n] is a sample sequence of a stationary random process. 

2. The error sequence is uncorrelated with the sequence x[ri\. 

3. The random variables of the error process are uncorrelated; i.e., the error is a 
white-noise process. 

4. The probability distribution of the error process is uniform over the range of 
quantization error. 

As we will see, the preceding assumptions lead to a rather simple analysis of quan- 
tization effects. It is easy to find situations where these assumptions are not valid. For 
example, if x a (t) is a step function, the assumptions would not be justified. However, 
when the signal is a complicated signal, such as speech or music, where the signal fluc- 
tuates rapidly in a somewhat unpredictable manner, the assumptions are more realistic. 
Experiments have shown that, as the signal becomes more complicated, the measured 
correlation between the signal and the quantization error decreases, and the error also 
becomes uncorrelated. (See Bennett, 1948; Widrow, 1956, 1961.) In a heuristic sense, 
the assumptions of the statistical model appear to be valid if the signal is sufficiently 
complex and the quantization steps are sufficiently small so that the amplitude of the 
signal is likely to traverse many quantization steps from sample to sample. 

Example 4.12 Quantization Error For a 
Sinusoidal Signal 

As an illustration, Figure 4.51(a) shows the sequence of unquantized samples of the 
cosine signal x[n] — 0.99cos(«/10). Figure 4.51(b) shows the quantized sample se- 
quence x[n] = Q[x[n]} for a 3-bit quantizer (5+1 =3), assuming that X m = 1. The 
dashed lines in this figure show the eight possible quantization levels. Figures 4.51(c) 
and 4.51(d) show the quantization error e[n] = x[n] — x[n] for 3-bit and 8-bit quanti- 
zation, respectively. In each case, the scale of the quantization error is adjusted so that 
the range ±A/2 is indicated by the dashed lines. 

Notice that in the 3-bit case, the error signal is highly correlated with the un- 
quantized signal. For example, around the positive and negative peaks of the cosine, 
the quantized signal remains constant over many consecutive samples, so that the er- 
ror has the shape of the input sequence during these intervals. Also, note that during 
the intervals around the positive peaks, the error is greater than A/2 in magnitude 
because the signal level is too large for this setting of the quantizer parameters. 

On the other hand, the quantization error for 8-bit quantization has no apparent 
patterns. 2 Visual inspection of these figures tends to confirm the preceding assertions 
about the quantization-noise properties in the finely quantized (8-bit) case; i.e., the 
error samples appear to vary randomly, with no correlation with the unquantized signal, 

2 For periodic cosine signals, the quantization error would, of course, be periodic, too. We used the 
frequency coq = 1/10 to avoid this case in the example. 
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Figure 4.51 Example of quantization noise, (a) Unquantized samples of the signal 
x[n] = 0.99cos(/?/10). (b) Quantized samples of the cosine waveform in part 
(a) with a 3-bit quantizer, (c) Quantization error sequence for 3-bit quantization of 
the signal in (a), (d) Quantization error sequence for 8-bit quantization of the 
signal in (a). 

and they range between — A /2 and + A /2. In Chapter 10 this will be demonstrated more 
quantitatively when we calculate the power density spectrum and autocorrelation of 
a quantization-noise sequence. 



For quantizers that round the sample value to the nearest quantization level, as 
shown in Figure 4.48, the amplitude of the quantization noise is in the range 



-A/2 < e[n] < A/2. 



(4.121) 



For small A, it is reasonable to assume that e[n] is a random variable uniformly dis- 
tributed from - A/2 to A/2. Therefore, the first-order probability density for the quan- 
tization noise is as shown in Figure 4.52. (If truncation rather than rounding is used 
in implementing quantization, then the error would always be negative, and we would 
assume a uniform probability density from —A to 0.) To complete the statistical model 
for the quantization noise, we assume that successive noise samples are uncorrelated 
with each other and that e[n] is uncorrelated with x[n]. Thus, e[n] is assumed to be 
a uniformly distributed white-noise sequence. The mean value of e[n] is zero, and its 
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Figure 4.52 Probability density 
function of quantization error for a 
rounding quantizer such as that of 
Figure 4.48. 



variance is 
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(4.122) 



For a (B + l)-bit quantizer with full-scale value X, n , the noise variance, or power, is 



)-2B 



X: 



cr„ 



12 



(4.123) 



A common measure of the amount of degradation of a signal by additive noise is the 
signal-to-noise ratio, defined as the ratio of signal variance (power) to noise variance. 
Expressed in decibels (dB), the signal-to-noise ratio of a (B + l)-bit quantizer is 



SNR= 101og I( 
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(4.124) 



From Eq. (4.124), we see that the signal-to-noise ratio increases approximately 6 dB for 
each bit added to the word length of the quantized samples, i.e., for each doubling of 
the number of quantization levels. It is particularly instructive to consider the term 



-20 log 



10 



A.n 



0\ 



(4.125) 



in Eq. (4.124). First recall that X m is a parameter of the quantizer, and it would usually 
be fixed in a practical system. The quantity o x is the rms value of the signal amplitude, 
and it would necessarily be less than the peak amplitude of the signal. For example, if 
x a (t) is a sine wave of peak amplitude X p , then o x — X p /V2. If o x is too large, the peak 
signal amplitude will exceed the full-scale amplitude X m of the A/D converter. In this 
case Eq. (4.124) is no longer valid, and severe distortion results. If, on the other hand, 
a x is too small, then the term in Eq. (4.125) will become large and negative, thereby 
decreasing the signal-to-noise ratio in Eq. (4.124). In fact, it is easily seen that when o x 
is halved, SNR decreases by 6 dB. Thus, it is very important that the signal amplitude 
be carefully matched to the full-scale amplitude of the A/D converter. 

For analog signals such as speech or music, the distribution of amplitudes tends 
to be concentrated about zero and falls off rapidly with increasing amplitude. In such 
cases, the probability that the magnitude of a sample will exceed three or four times the 
rms value is very low. For example, if the signal amplitude has a Gaussian distribution, 
only 0.064 percent of the samples would have an amplitude greater than 4a x . Thus, to 
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avoid clipping the peaks of the signal (as is assumed in our statistical model), we might 
set the gain of filters and amplifiers preceding the A/D converter so that a x = X„,/4. 
Using this value of o x in Eq. (4.124) gives 



SNR%6fl-1.25dB. 



(4.126) 



For example, obtaining a signal-to-noise ratio of about 90-96 dB for use in high-quality 
music recording and playback requires 1 6-bit quantization, but it should be remembered 
that such performance is obtained only if the input signal is carefully matched to the 
full-scale range of the A/D converter. 

This trade-off between peak signal amplitude and absolute size of the quantization 
noise is fundamental to any quantization process. We will see its importance again in 
Chapter 6 when we discuss round-off noise in implementing discrete-time linear systems. 

4.8.4 D/A Conversion 

In Section 4.3, we discussed how a bandlimited signal can be reconstructed from a 
sequence of samples using ideal lowpass filtering. In terms of Fourier transforms, the 
reconstruction is represented as 



X r {j&) = X(e^ T )H r (jQ), 



(4.127) 



where X{e }<1> ) is the discrete-time Fourier transform of the sequence of samples and 
X r (jQ) is the Fourier transform of the reconstructed continuous-time signal. The ideal 
reconstruction filter is 



w '<' a > = {o, \a\>J/T. (4J28) 

For this choice of H r (jQ), the corresponding relation between x r (t) and x[n] is 

sin[jr(r -nT)/T] 



x r (t) = J2 *M 



n(t -nT)/T 



(4.129) 



The system that takes the sequence x[n] as input and produces x r (t) as output is called 
the ideal D/C converter. A physically realizable counterpart to the ideal D/C converter 
is a digital-to-analog converter (D/A converter) followed by an approximate lowpass 
filter. As depicted in Figure 4.53(a), a D/A converter takes a sequence of binary code 
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Figure 4.53 (a) Block diagram of D/A 
converter, (b) Representation in terms of 
a zero-order hold. 
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words as its input and produces a continuous-time output of the form 

oc 

xda(0= Y x mXB[n]h {) {t -nT) 

I1 — — OC 

oc 

= Y x[n]h (t-nT), 



(4.130) 



where h$(t) is the impulse response of the zero-order hold given by Eq. (4.112). The 
dotted lines in Figure 4.49 show the output of a D/A converter for the quantized ex- 
amples of the sine wave. Note that the D/A converter holds the quantized sample for 
one sample period in the same way that the sample-and-hold holds the unquantized in- 
put sample. If we use the additive-noise model to represent the effects of quantization, 
Eq. (4.130) becomes 



xda(0= Y x[n]h (t-nT)+ Y e[n]h Q (t - nT). 

/( = — OC II — — oc 

To simplify our discussion, we define 

OC 

*o(0= Y x[n]h {) (t-nT), 



n = — oc 

Oc 



eo(t)= Y e[n]hu(t-nT), 



(4.131) 

(4.132) 
(4.133) 



so that Eq. (4.131) can be written as 

XDA(t)=xo(t) + e (t). (4.134) 

The signal component xq(0 is related to the input signal x a (t), since x[n] = x a (nT). 
The noise signal eo(t) depends on the quantization-noise samples e[n] in the same 
way that Xo(t) depends on the unquantized signal samples. The Fourier transform of 
Eq. (4.132) is 



Xo(jn) = Y x[n]H (jQ)e 
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(4.137) 
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If X a (jQ) is bandlimited to frequencies below iz/T, the shifted copies of X a (jQ) do 
not overlap in Eq. (4.137), and if we define a compensated reconstruction filter as 



H r (jQ) = 






(4.138) 



then the output of the filter will be x a (t) if the input is xo(t). The frequency response of 
the zero-order-hold filter is easily shown to be 



_ 2sin(QT/2) jQT/2 



HoUn) = 

Therefore, the compensated reconstruction filter is 

QT/2 



(4.139) 



H r (jQ) = { sin(S2772) 

0, 



\Q\ > n jT. 



(4.140) 



Figure 4.54(a) shows \Hq(jQ)\ as given by Eq. (4.139), compared with the magnitude 
of the ideal interpolation filter \H r (jQ)\ as given by Eq. (4.128). Both filters have a 
gain of T at Q = 0, but the zero-order-hold, although lowpass in nature, does not 
cut off sharply at Q = it f T. Figure 4.54(b) shows the magnitude of the frequency 
response of the ideal compensated reconstruction filter to be used following a zero- 
order-hold reconstruction system such as a D/A converter. The phase response would 
ideally correspond to an advance time shift of 7/2 seconds to compensate for the delay 
of that amount introduced by the zero-order hold. Since such a time advance cannot be 
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Figure 4.54 (a) Frequency response 
of zero-order hold compared with ideal 
interpolating filter, (b) Ideal 
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use with a zero-order-hold output. 
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Figure 4.55 Physical configuration for 
digital-to-analog conversion. 



realized in practical real-time approximations to the ideal compensated reconstruction 
filter, only the magnitude response would normally be compensated, and often even 
this compensation is neglected, since the gain of the zero-order hold drops only to 2/tt 
(or -4 dB) at Q =tt/T. 

Figure 4.55 shows a D/A converter followed by an ideal compensated recon- 
struction filter. As can be seen from the preceding discussion, with the ideal compen- 
sated reconstruction filter following the D/A converter, the reconstructed output sig- 
nal would be 



x r (t) = y, *M 



s\n[n(t -nT)/T] 
n(t-nT)/T 

sin[)r(/ - nT)/T] 



+ 



E *M 



sin[jr(f -n T)/ T] 
n(t -nT)/T 



(4.141) 



7t(t -nT)jT 

In other words, the output would be 

x r (t)=x a (t) + e a (t). (4.142) 

where e a (t) would be a bandlimited white-noise signal. 

Returning to a consideration of Figure 4.41(b), we are now in a position to un- 
derstand the behavior of systems for digital processing of analog signals. If we assume 
that the output of the antialiasing filter is bandlimited to frequencies below itj 7, that 
H r (jQ) is similarly bandlimited, and that the discrete-time system is linear and time 
invariant, then the output of the overall system will be of the form 



where 



^(0 = ^(0 + ^(0, 
Y a (jQ) = H r (jn)H (jn)H(e^ T )H aa (jn)X c (jn), 



(4.143) 
(4.144) 



in which H aa (jQ), Hq(j'Q), and H r (jQ) are the frequency responses of the antialiasing 
filter, the zero-order hold of the D/A converter, and the reconstruction lowpass filter, 
respectively. H(e^ T ) is the frequency response of the discrete-time system. Similarly, 
assuming that the quantization noise introduced by the A/D converter is white noise 
with variance aj = A 2 / 12, it can be shown that the power spectrum of the output noise is 



P ea (jQ) = \H r (jQ)H (jQ)H(e^ T )\ 2 al 



(4.145) 



i.e., the input quantization noise is changed by the successive stages of discrete- and 
continuous-time filtering. From Eq. (4.144), it follows that, under the assumption of 
negligible aliasing, the overall effective frequency response from x c (t) to y r (t) is 



//effO'fl) = H r (jn)H (jn)H(e^ T )H aa (jn). 



(4.146) 
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If the antialiasing filter is ideal, as in Eq. (4.108), and if the compensation of the re- 
construction filter is ideal, as in Eq. (4.140), then the effective frequency response is 
as given in Eq. (4.109). Otherwise Eq. (4.146) provides a reasonable model for the ef- 
fective response. Note that Eq. (4.146) suggests that compensation for imperfections in 
any of the four terms can, in principle, be included in any of the other terms; e.g., the 
discrete-time system can include appropriate compensation for the antialiasing filter or 
the zero-order hold or the reconstruction filter or all of these. 

In addition to the filtering supplied by Eq. (4.146), Eq. (4.143) reminds us that the 
output will also be contaminated by the filtered quantization noise. In Chapter 6 we 
will see that noise can be introduced as well in the implementation of the discrete-time 
linear system. This internal noise will, in general, be filtered by parts of the discrete- 
time system implementation, by the zero-order hold of the D/A converter, and by the 
reconstruction filter. 

4.9 OVERSAMPLING AND NOISE SHAPING IN A/D 
AND D/A CONVERSION 

In Section 4.8. 1 , we showed that oversampling can make it possible to implement sharp- 
cutoff antialiasing filtering by incorporating digital filtering and decimation. As we 
discuss in Section 4.9. 1 , oversampling and subsequent discrete-time filtering and down- 
sampling also permit an increase in the step size A of the quantizer or, equivalently, 
a reduction in the number of bits required in the analog-to-digital conversion. In Sec- 
tion 4.9.2 we show how the step size can be reduced even further by using oversampling 
together with quantization-noise feedback, and in Section 4.9.3 we show how the over- 
sampling principle can be applied in D/A conversion. 



4.9.1 Oversampled A/D Conversion with Direct Quantization 

To explore the relation between oversampling and the quantization step size, we con- 
sider the system in Figure 4.56. To analyze the effect of oversampling in this system, we 
consider x t ,(t) to be a zero-mean, wide-sense-stationary, random process with power- 
spectral density denoted by <P XiiXti (j&) and autocorrelation function denoted by <Av„.v (I ( T )- 
To simplify our discussion, we assume initially that x a (t) is already bandlimited to £2,v, 
i.e.. 
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(4.147) 
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Figure 4.56 Oversampled A/D conversion with simple quantization and down- 
sampling. 
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Figure 4.57 System of Figure 4.56 with quantizer replaced by linear noise model. 



and we assume that 2tt/ T = 2MQ^. The constant M, which is assumed to be an integer, 
is called the oversampling ratio. Using the additive noise model discussed in detail 
in Section 4.8.3, we can replace Figure 4.56 by Figure 4.57. The decimation filter in 
Figure 4.57 is an ideal lowpass filter with unity gain and cutoff frequency co c = n/M. 
Because the entire system of Figure 4.57 is linear, its output Xd[n] has two components, 
one due to the signal input x a (t) and one due to the quantization noise input e[n\. We 
denote these components by JCrf a [«] and x t i e [n], respectively. 

Our goal is to determine the ratio of signal power £{*;/<! ["]} to quantization-noise 
power f {jc^[«]} in the output x ( i[n] as a function of the quantizer step size A and the 
oversampling ratio M. Since the system of Figure 4.57 is linear, and since the noise is 
assumed to be independent of the signal, we can treat the two sources separately in 
computing the respective powers of the signal and noise components at the output. 

First we will consider the signal component of the output. We begin by relating 
the power spectral density, autocorrelation function, and signal power of the sampled 
signal x[n] to the corresponding functions for the continuous-time analog signal x a (t). 
Let <j) xx [m\ and O XI (e ;w ) respectively denote the autocorrelation and power spectral 
density of x[n\. Then, by definition, <p xx [m] = £ {x[n + m]x[n]} , and since x[n] = x a (nT) 
and x[n + m] = x a (nT + mT), 



Therefore, 



£{x[n + m\x[n]} — £{x a ((n + m)T)x a (nT)}. 



4>xx[m] =4>x a x a (mT)\ 



(4.148) 



(4.149) 



i.e., the autocorrelation function of the sequence of samples is a sampled version of 
the autocorrelation function of the corresponding continuous-time signal. In particular, 
Eqs. (4.148) and (4.149), together with the wide-sense-stationarity assumption, imply 
that £[xl(t)} is a constant independent oft. It then follows that 

£{x 2 [n]} = £{x 2 a {nT)} = £{x 2 a (t)} for all n or t. (4.150) 

Since the power spectral densities are the Fourier transforms of the autocorrelation 
functions, as a consequence of Eq. (4.149), 



^' 2r )4E*«(/(2-y)) 



(4.151) 



k=— oo 



Assuming that the input is bandlimited as in Eq. (4.147), and assuming oversampling 
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tt —ttIM 



ttIM tt 



(b) 



Figure 4.58 Illustration of frequency and amplitude scaling between <t> XaXa {jQ) 
and <t> xx (ei"). 

by a factor of M so that 2n/T = IMQ^i, we obtain, by substituting Q = co/T into 
Eq. (4.151) 

1 / co\ 




(4.152) 

71 j M < CO < It. 

For example, if <t> XiiXii (jQ) is as depicted in Figure 4.58(a), and if we choose the sampling 
rate to be 2it/ T — 2MQ N , then ^ xx (e' lto ) will be as depicted in Figure 4.58(b). 

It is instructive to demonstrate that Eq. (4.150) is true by utilizing the power 
spectrum. The total power of the original analog signal is given by 

From Eq. (4.152), the total power of the sampled signal is 



E{x 2 [n}} = -L f <P xx (end*> 

2* J-n 



1 



(4.153) 
(4.154) 



2tz J^ IM T® x ° Xa V TJ 

Using the fact that Q N T = tt/M and making the substitution Q — co/T in Eq. (4.154) 
gives 

£{* 2 [n]} = ^ J " <i> XaXa (jn)dn = S{x 2 a (t)). 

Thus, the total power of the sampled signal and the total power of the original analog 
signal are exactly the same. Since the decimation filter is an ideal lowpass filter with 
cutoff co c = tt/M, the signal x[n] passes unaltered through the filter. Therefore, the 
downsampled signal component at the output, x da [n] = x[nM] = x a (nMT), also has 
the same total power. This can be seen from the power spectrum by noting that, since 
®xx(e^) is bandlimited to |o>| < tc/M, 



d> 



1 Af-l 



M 
1 



k=Q 



(4.155) 



= -rz^ x (e Jw/M ) M < TT. 

M 
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Using Eq. (4.155), we obtain 

£X J -71 

2jt J^ M 



1 PIT/ M 

= tt / 4> xx (endo> = £[x 2 [n]l 

Z- 71 J-7T/M 

which shows that the power of the signal component stays the same as it traverses the 
entire system from the input x a (t) to the corresponding output component jc f / tf [n]. In 
terms of the power spectrum, this occurs because, for each scaling of the frequency axis 
that results from sampling, we have a counterbalancing inverse scaling of the amplitude, 
so that the area under the power spectrum remains the same as we go from <& XiiXii (j&) 
to <X> xx (e' }l °) to <& Xdu x d Ae ito ) by sampling. 

Now let us consider the noise component that is generated by quantization. 
According to the model in Section 4.8.3, we assume that e[n] is a wide-sense-stationary 
white-noise process with zero mean and variance 3 

s a2 

Consequently, the autocorrelation function and power density spectrum for e[n] are, 
respectively, 

4>e e [m] = o?8[m] (4.156) 

and 

<t> ee (e iw ) = a} \a>\<jt. (4.157) 

In Figure 4.59, we show the power density spectrum of e[n] and of x[ri\. The power 
density spectrum of the quantized signal x[n] is the sum of these, since the signal and 
quantization-noise samples are assumed to be independent in our model. 

Although we have shown that the power in either x[n] or e[n] does not depend 
on M, we note that as the oversampling ratio M increases, less of the quantization- 
noise spectrum overlaps with the signal spectrum. It is this effect of the oversampling 
that lets us improve the signal-to-quantization-noise ratio by sampling-rate reduction. 
Specifically, the ideal lowpass filter removes the quantization noise in the band tt/M < 
\o)\ < it, while it leaves the signal component unaltered. The noise power at the output 
of the ideal lowpass filter is 



1 pji J M 

£[e 2 [n]} = 7T / a 1 d <» 

Z- 71 J-7T/M 



x/M 2 

M 



Next, the lowpass filtered signal is downsampled, and, as we have seen, the signal power 
in the downsampled output remains the same. In Figure 4.60, we show the resulting 

3 Since the random process has zero mean, the average power and the variance are the same. 
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Figure 4.59 Power spectral density of 
signal and quantization noise with an 
oversampling factor of M. 
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Figure 4.60 Power spectral density of 
signal and quantization noise after 
downsampling. 



power density spectrum of both jc,/«[ai] and Jt</ f [/i]. Comparing Figures 4.58(b), 4.59. and 
4.60, we can see that the area under the power density spectrum for the signal has not 
changed, since the frequency axis and amplitude axis scaling have been inverses of each 
other. On the other hand, the noise power in the decimated output is the same as at the 
output of the lowpass filter; i.e., 



£\*l\ = 



l 

2^ 



jT M M 12M 



(4.158) 



Thus, the quantization-noise power £{jtf ff ,[/i]} has been reduced by a factor of M through 
the filtering and downsampling, while the signal power has remained the same. 

From Eq. (4.158), we see that for a given quantization noise power, there is a 
clear trade-off between the oversampling factor M and the quantizer step size A. Equa- 
tion (4.115) states that for a quantizer with (B+ 1) bits and maximum input signal level 
between plus and minus X m , the step size is 



A = X m fT 



and therefore, 



v 2 



£[Xdeln]} = 



1 



Y1M V 2 B 



X K 



(4.159) 



Equation (4.159) shows that for a fixed quantizer, the noise power can be decreased 
by increasing the oversampling ratio M. Since the signal power is independent of M, 
increasing M will increase the signal-to-quantization-noise ratio. Alternatively, for a 
fixed quantization noise power P^ = £{xj e [n]}, the required value for B is 



1 1 1 

B = - - log 2 M-- log 2 12 - - log 2 P de + log 2 X, 



(4.160) 



From Eq. (4.160), we see that for every doubling of the oversampling ratio A/, we need 
1/2 bit less to achieve a given signal-to-quantization-noise ratio, or, in other words, if 
we oversample by a factor M = 4, we need one less bit to achieve a desired accuracy in 
representing the signal. 
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4.9.2 Oversampled A/D Conversion with Noise Shaping 

In the previous section, we showed that oversampling and decimation can improve the 
signal-to-quantization-noise ratio. This seems to be a somewhat remarkable result. It 
implies that we can, in principle, use very crude quantization in our initial sampling of 
the signal, and if the oversampling ratio is high enough, we can still obtain an accurate 
representation of the original samples by doing digital computation on the noisy sam- 
ples. The problem with what we have seen so far is that, to make a significant reduction 
in the required number of bits, we need very large oversampling ratios. For example, to 
reduce the number of bits from 16 to 12 would require M = 4 4 = 256. This seems to be 
a rather high cost. However, the basic oversampling principle can lead to much higher 
gains if we combine it with the concept of noise spectrum shaping by feedback. 

As was indicated in Figure 4.59, with direct quantization the power density spec- 
trum of the quantization noise is constant over the entire frequency band. The basic 
concept in noise shaping is to modify the A/D conversion procedure so that the power 
density spectrum of the quantization noise is no longer uniform, but rather, is shaped 
such that most of the noise power is outside the band \co\ < it j M. In that way, the subse- 
quent filtering and downsampling removes more of the quantization-noise power. 

The noise-shaping quantizer, generally referred to as a sampled-data Delta-Sigma 
modulator, is shown in Figure 4.61 . (See Candy and Temes, 1 992 for a collection of papers 
on this topic.) Figure 4.61(a) shows a block diagram of how the system is implemented 
with integrated circuits. The integrator is a switched-capacitor discrete-time integrator. 
The A/D converter can be implemented in many ways, but generally, it is a simple 
1 -bit quantizer or comparator. The D/ A converter takes the digital output and converts 
it back to an analog pulse that is subtracted from the input signal at the input to the 
integrator. This system can be represented by the discrete-time equivalent system shown 
in Figure 4.61(b). The switched-capacitor integrator is represented by an accumulator 
system, and the delay in the feedback path represents the delay introduced by the D/A 
converter. 
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Figure 4.61 Oversampled quantizer with noise shaping. 
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As before, we model the quantization error as an additive noise source so that the 
system in Figure 4.61 can be replaced by the linear model in Figure 4.62. In this system, 
the output y[n] is the sum of two components: y x [n] due to the input x[n] alone and e[n] 
due to the noise e[n] alone. 

We denote the transfer function from x[n] to y[n] as H x (z) and from e[n] to y[n] 

as H e (z). These transfer functions can both be calculated in a straightforward manner 

and are 

H x (z) = h (4.161a) 

//,(*) = (1 -z~ l ). (4.161b) 

Consequently, 

y x [n] = x[n], (4.162a) 



and 



e[n] = e[n] - e[n - 1]. 



(4.162b) 



Therefore, the output y[n] can be represented equivalently as y[n] = x[n] + e[n], where 
x[n] appears unmodified at the output and the quantization noise e[n] is modified by the 
first-difference operator H e (z). This is depicted in the block diagram in Figure 4.63. With 
the power density spectrum for e[n] given by Eq. (4.157), the power density spectrum 
of the quantization noise e[n] that is present in y[n] is 



Q>ee(ei to ) = a?\H e (e> t ' t )\ 2 

= a?[2sin(co/2)] 2 . 



(4.163) 




x An\ 



Figure 4.62 System of Figure 4.60 from x a {t) to y[n] with quantizer replaced by 
a linear noise model. 
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Figure 4.63 Equivalent representation of Figure 4.62. 
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In Figure 4.64, we show the power density spectrum of e[n], the power spectrum of e[n], 
and the same signal power spectrum that was shown in Figure 4.58(b) and Figure 4.59. 
It is interesting to observe that the total noise power is increased from £{e 2 [/?]} = <r 2 
at the quantizer to £{£ 2 [>t]} = 2a] at the output of the noise-shaping system. However, 
note that in comparison with Figure 4.59, the quantization noise has been shaped in 
such a way that more of the noise power is outside the signal band |a»| < tz/M than in 
the direct oversampled case, where the noise spectrum is flat. 

In the system of Figure 4.61, this out-of-band noise power is removed by the low- 
pass filter. Specifically, in Figure 4.65 we show the power density spectrum of & XtlaXdll (e^ ( °) 
superimposed on the power density spectrum of <£ x> . u .( e ^°)- Since the downsampler 
does not remove any of the signal power, the signal power in x f / w [/i] is 

P da = S[x 2 da [n\\ = £{x 2 [n]} = £{xl{t)). 

The quantization-noise power in the final output is 

p de = — I 4> XM ,(endu> = —^r, / (2sin (^)) dcv. (4.164) 



2tt ./_ 



2tt MM I 



2M 



To compare this approximately with the results in Section 4.9.1, assume that M is suffi- 
ciently large so that 

. / OJ \ CO 

sin % . 

\2MJ 2M 



0> ?? (^^)=4c7-, 2 sin 2 (6>/2) 




Figure 4.64 The power spectral density of the quantization noise and the signal. 




Figure 4.65 Power spectral density of the signal and quantization noise after 
downsampling. 
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With this approximation, Eq. (4.164) is easily evaluated to obtain 

1 A 2 7T 2 



Pde — 



36 M 3 



(4.165) 



From Eq. (4.165), we see again a trade-off between the oversampling ratio M and 
the quantizer step size A. For a (B + l)-bit quantizer and maximum input signal level 
between plus and minus X m , A = X,„/2 B . Therefore, to achieve a given quantization- 
noise power P (le , we must have 



3 1 

B =~2 l ° g2 M + lo &( n /ty ~ j l0g2 Pde + l0g2 X " ] ' 



(4.166) 



Comparing Eq. (4.166) with Eq. (4.160), we see that, whereas with direct quantization 
a doubling of the oversampling ratio M gained 1/2 bit in quantization, the use of noise 
shaping results in a gain of 1 .5 bits. 

Table 4.1 gives the equivalent savings in quantizer bits over direct quantization 
with no oversampling (M = 1) for (a) direct quantization with oversampling, as dis- 
cussed in Section 4.9.1, and (b) oversampling with noise shaping, as examined in this 
section. 

TABLE 4.1 EQUIVALENT SAVINGS IN 
QUANTIZER BITS RELATIVE TO M = 1 FOR 
DIRECT QUANTIZATION AND FIRST-ORDER 
NOISE SHAPING 





Direct 


Noise 


M 


quantization 


shaping 


4 


1 


2.2 


8 


1.5 


3.7 


16 


2 


5.1 


32 


2.5 


6.6 


64 


3 


8.1 



The noise-shaping strategy in Figure 4.61 can be extended by incorporating a 
second stage of accumulation as shown in Figure 4.66. In this case, with the quantizer 
again modeled as an additive noise source e[ri], it can be shown that 

y[n] = x[n] + e[n] 

where, in the two-stage case, e[n] is the result of processing the quantization noise e[n\ 
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Figure 4.66 Oversampled quantizer with second-order noise shaping. 
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TABLE 4.2 REDUCTION IN QUANTIZER 
BITS AS ORDER p OF NOISE SHAPING 







Oversampling 


factor M 




Quantizer 
order p 












4 


8 


16 


32 


64 





1.0 


1.5 


2.0 


2.5 


3.0 


1 


2.2 


3.7 


5.1 


6.6 


8.1 


2 


2.9 


5.4 


7.9 


10.4 


12.9 


3 


3.5 


7.0 


10.5 


14.0 


17.5 


4 


4.1 


8.5 


13.0 


17.5 


22.0 


5 


4.6 


10.0 


15.5 


21.0 


26.5 



through the transfer function 

H e (z) = (\-z~ x ) 2 . (4.167) 

The corresponding power density spectrum of the quantization noise now present in 
y[n] is 

<MO = ^[2sin(co/2))\ (4.168) 

with the result that, although the total noise power at the output of the two-stage noise- 
shaping system is greater than for the one-stage case, even more of the noise lies outside 
the signal band. More generally, p stages of accumulation and feedback can be used, 
with corresponding noise shaping given by 

<p^(e jw ) = aj[2sm(aj/2)] 2 '\ (4.169) 

In Table 4.2, we show the equivalent reduction in quantizer bits as a function of the order 
p of the noise shaping and the oversampling ratio M. Note that with p = 2 and M = 64, 
we obtain almost 13 bits of increase in accuracy, suggesting that a 1-bit quantizer could 
achieve about 14-bit accuracy at the output of the decimator. 

Although multiple feedback loops such as the one shown in Figure 4.66 promise 
greatly increased noise reduction, they are not without problems. Specifically, for large 
values of p, there is an increased potential for instability and oscillations to occur. 
An alternative structure known as multistage noise shaping (MASH) is considered in 
Problem 4.62. 



4.9.3 Oversampling and Noise Shaping 
in D/A Conversion 

In Sections 4.9.1 and 4.9.2, we discussed the use of oversampling to simplify the process 
of analog-to-digital conversion. As we mentioned, the signal is initially oversampled 
to simplify antialias filtering and improve accuracy, but the final output xa\n\ of the 
A/D converter is sampled at the Nyquist rate for x a (t). The minimum sampling rate is, 
of course, highly desirable for digital processing or for simply representing the analog 
signal in digital form, as in the CD audio recording system. It is natural to apply the 
same principles in reverse to achieve improvements in the D/A conversion process. 

The basic system, which is the counterpart to Figure 4.56, is shown in Figure 4.67. 
The sequence yd[n], which is to be converted to a continuous-time signal, is first 
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Figure 4.67 Oversampled D/A conversion. 
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Figure 4.68 First-order noise-shaping 
system for oversampled D/A 
quantization. 
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Figure 4.69 System of Figure 4.68 
with quantizer replaced by linear noise 
model. 



upsampled to produce the sequence y[n], which is then requantized before sending 
it to a D/A converter that accepts binary samples with the number of bits produced by 
the requantization process. We can use a simple D/A converter with few bits if we can 
be assured that the quantization noise does not occupy the signal band. Then the noise 
can be removed by inexpensive analog filtering. 

In Figure 4.68, we show a structure for the quantizer that shapes the quantization 
noise in a similar manner to the first-order noise shaping provided by the system in 
Figure 4.61. To analyze the system in Figures 4.67 and 4.68, we replace the quantizer 
in Figure 4.68 by an additive white-noise source e[n], so that Figure 4.68 is replaced by 
Figure 4.69. The transfer function from y[n] to y[n] is unity, i.e. the upsampled signal 
y[n] appears at the output unaltered. The transfer function H e (z) from e[n] to y[n] is 



H e (z) = l-z 
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Therefore, the quantization noise component e[n] that appears at the output of the 
noise-shaping system in Figure 4.69 has the power density spectrum 

<Me /<w ) = cr d ?(2sin w/2) 2 , (4.170) 

where, again, o- 2 — A 2 /12. 

An illustration of this approach to D/A conversion is given in Figure 4.70. Fig- 
ure 4.70(a) shows the power spectrum <t> v ,, v ,,(e ;w ) of the input y ( i[n} in Figure 4.67. Note 
that we assume that the signal y t t[n] is sampled at the Nyquist rate. Figure 4.70(b) shows 
the corresponding power spectrum at the output of the upsampler (by M), and Fig- 
ure 4.70(c) shows the quantization noise spectrum at the output of the quantizer/noise- 
shaper system. Finally, Figure 4.70(d) shows the power spectrum of the signal component 
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Figure 4.70 (a) Power spectral density of signal ya[ri\ . (b) Power spectral density 
of signal y[n]. (c) Power spectral density of quantization noise, (d) Power spectral 
density of the continuous-time signal and the quantization noise. 
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superimposed on the power spectrum of the noise component at the analog output of 
the D/C converter of Figure 4.67. In this case, we assume that the D/C converter has an 
ideal lowpass reconstruction filter with cutoff frequency tt/(MT), which will remove as 
much of the quantization noise as possible. 

In a practical setting, we would like to avoid sharp-cutoff analog reconstruction 
filters. From Figure 4.70(d), it is clear that if we can tolerate somewhat more quantization 
noise, then the D/C reconstruction filter need not roll off so sharply. Furthermore, if we 
use multistage techniques in the noise shaping, we can obtain an output noise spectrum 
of the form 

<D#(e'' w ) =<r f 2 (2sinoV2) 2 '\ 

which would push more of the noise to higher frequencies. In this case, the analog 
reconstruction filter specifications could be relaxed even further. 



4.10 SUMMARY 

In this chapter, we developed and explored the relationship between continuous-time 
signals and the discrete-time sequences obtained by periodic sampling. The fundamental 
theorem that allows the continuous-time signal to be represented by a sequence of 
samples is the Nyquist theorem, which states that, for a bandlimited signal, periodic 
samples are a sufficient representation, as long as the sampling rate is sufficiently high 
relative to the highest frequency in the continuous-time signal. Under this condition, 
the continuous-time signal can be reconstructed from the samples by lowpass filtering, 
corresponding to bandlimited interpolation. If the sampling rate is too low relative to 
the bandwidth of the signal, then aliasing distortion occurs. 

The ability to represent signals by sampling permits the discrete-time processing of 
continuous-time signals. This is accomplished by first sampling, then applying discrete- 
time processing, and, finally, reconstructing a continuous-time signal from the result. 
Examples given were lowpass filtering and differentiation. 

A particularly important class of processing is the class corresponding to sampling 
rate changes. Downsampling a discrete-time signal corresponds in the frequency domain 
to a replication of the discrete-time spectrum and rescaling of the frequency axis, which 
may require additional bandlimiting to avoid aliasing. Upsampling corresponds to ef- 
fectively increasing the sampling rate and is also represented in the frequency domain 
by a rescaling of the frequency axis. By combining upsampling and downsampling by 
integer amounts, noninteger sampling rate conversion can be achieved. We also showed 
how this can be efficiently done using multirate techniques. 

In the final sections of the chapter, we explored a number of practical considera- 
tions associated with the discrete-time processing of continuous-time signals, including 
the use of prefiltering to avoid aliasing, quantization error in analog-to-digital conver- 
sion, and some issues associated with the filtering used in sampling and reconstruct- 
ing the continuous-time signals. Finally, we showed how discrete-time decimation and 
interpolation and noise shaping can be used to simplify the analog side of A/D and 
D/A conversion. 
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PROBLEMS 



Basic Problems with Answers 



4.1. The signal 

* t .(f) = sin(2jr(100)f) 

was sampled with sampling period T — 1/400 second to obtain a discrete-time signal x[n]. 
What is the resulting signal x[n]? 

4.2. The sequence 



x[n] = cos ( — n 



71 



-oo < n < oo. 



was obtained by sampling a continuous-time signal 

x c (t) = cos(Q{)t), — oo < t < oo, 

at a sampling rate of 1000 samples/s. What are two possible positive values of ^o that could 
have resulted in the sequence x[n]? 

4.3. The continuous-time signal 

jt c .(0 = cos(4(XX)jrO 
is sampled with a sampling period T to obtain a discrete-time signal 



x[n] =cos f — J . 



(a) Determine a choice for T consistent with this information. 

(b) Is your choice for T in Part (a) unique? If so, explain why. If not, specify another choice 
of T consistent with the information given. 

4.4. The continuous-time signal 

x c (t) = sin (20717) + cos (40jz7) 
is sampled with a sampling period T to obtain the discrete-time signal 

r , . / 7in\ (ijin 

x[n\ — sin I — 1 + cos I — — 

(a) Determine a choice for T consistent with this information. 

(b) Is your choice for T in Part (a) unique? If so, explain why. If not, specify another choice 
of T consistent with the information given. 

4.5. Consider the system of Figure 4.11, with the discrete-time system an ideal lowpass filter 
with cutoff frequency jt/8 radians/s. 

(a) If x c (t) is bandlimited to 5 kHz, what is the maximum value of T that will avoid aliasing 
in the C/D converter? 

(b) If 1/ T = 10 kHz, what will the cutoff frequency of the effective continuous-time filter 
be? 

(c) Repeat Part (b) for l/T = 20 kHz. 

4.6. Let h c (t) denote the impulse response of a linear time-invariant continuous-time filter and 
h ( i[n\ the impulse response of a linear time-invariant discrete-time filter. 
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<a) If 



M') = 



e-<". t >0, 



0, 



t <0, 



where « is a positive real constant, determine the continuous-time filter frequency 
response and sketch its magnitude. 

(b) If /7 ( /[«] = Th c (nT) with /7 t (7) as in part (a), determine the discrete-time filter frequency 
response and sketch its magnitude. 

(c) For a given value of a, determine, as a function of 7, the minimum magnitude of the 
discrete-time filter frequency response. 

4.7. Asimple model of a multipath communication channel is indicated in Figure P4.7-1. Assume 
that s c (t) is bandlimited such that S t .(jQ) = for \Q\ > tt/T and that x c (t) is sampled with 
a sampling period T to obtain the sequence 

x[n] =x c (nT). 



sAO 



Delay 



*,(/) = S c (t) + ff S c (t - T (J ) 



Figure P4.7-1 

(a) Determine the Fourier transform ofx c (t) and the Fourier transform of x[n] in terms of 
S c (jQ). 

(b) We want to simulate the multipath system with a discrete-time system by choosing 
H(ei" ! ) in Figure P4.7-2 so that the output r[n] = x c (nT) when the input is s[n] = 
s c (nT). Determine H(e j '°) in terms of T and 77/. 

(c) Determine the impulse response h[n] in Figure P4. 7-2 when (i) rj = 7and(ii)r^ = 7/2. 



s[n]=s c (nT) 



*- H(e^) 



r[n]=x t .{nT) 



Figure P4.7-2 



4.8. Consider the system in Figure P4.8-1 with the following relations: 

X c (jQ) =0. \£l\ >2n x 10 4 , 

x[n] - x c {nT). 



in] = rJ2 *M- 



A"— — 3C 



V,(/) 



C/D 



x[n] 



h[n] 
H(e J0J ) 






y(«] 






Figure P4.8-1 



(a) For this system, what is the maximum allowable value of T if aliasing is to be avoided, 
i.e., so that x c (t) can be recovered from x[n]. 

(b) Determine h[n]. 
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(c) In terms of X(e JaJ ), what is the value of y[n] for n — oo? 

(d) Determine whether there is any value of 7 for which 



y[n] 



x c {t)dt. (P4.8-1) 



If there is such a value for 7, determine the maximum value. If there is not, explain and 
specify how 7 would be chosen so that the equality in Eq. (P4.8-1 ) is best approximated. 

4.9. Consider a stable discrete-time signal x[n] whose discrete-time Fourier transform X(e )aj ) 
satisfies the equation 

X{e jw ) = X(e j{w - 7T) ) 

and has even symmetry, i.e., x[n] — x[—n], 

(a) Show that X(e^ to ) is periodic with a period n. 

(b) Find the value of x[3]. (Hint: Find values for all odd-indexed points.) 

(c) Let y[n] be the decimated version of x[n], i.e., y[n] = x[2n]. Can you reconstruct x[n] 
from y[n] for all n. If yes, how? If no, justify your answer. 

4.10. Each of the following continuous-time signals is used as the input x c (t) for an ideal C/D 
converter as shown in Figure 4.1 with the sampling period 7 specified. In each case, find 
the resulting discrete-time signal x[n]. 

(a) x c (t) = cos (2tt(1000)0 , 7 = (1/3000) sec 

(b) jc t .(0 = sin(2jr(1000)/), 7 = (1/1500) sec 

(c) jc t .(0 = sin(2jr(1000)f)/(jrf), 7 = (1/5000) sec 

4.11. The following continuous-time input signals x c (t) and corresponding discrete-time output 
signals x[n] are those of an ideal C/D as shown in Figure 4.1. Specify a choice for the 
sampling period 7 that is consistent with each pair of x c (t) and x[n]. In addition, indicate 
whether your choice of 7 is unique. If not, specify a second possible choice of 7 consistent 
with the information given. 

(a) x c (t) = sin(lOjrf), x[n] = sin(:rw/4) 

(b) x c (t) = sin(10jrf)/(10jrf), x[n] = sin(jrn/2)/(jrn/2) 

4.12. In the system of Figure 4.1 1, assume that 

H(e j( °) = JU)/ 7, -7T <OJ <7T, 

and T — 1/10 sec. 

(a) For each of the following inputs x c (t), find the corresponding output y c (t). 
(i) x c (t) = cos(6tt/) 

(ii) x c (t) = cos(14ji7) 

(b) Are the outputs y c (t) those you would expect from a differentiator? 

4.13. In the system shown in Figure 4.16, h c (t) = S(t — 7/2). 

(a) Suppose the input x[n] = sin(jrrc/2) and 7 = 10. Find y[n]. 

(b) Suppose you use the same x[n] as in Part (a), but halve 7 to be 5. Find the resulting 
y[n]. 

(c) In general, how does the continuous-time LTI system h c (t) limit the range of the sam- 
pling period 7 that can be used without changing y[n]7 

4.14. Which of the following signals can be downsampled by a factor of 2 using the system in 
Figure 4.20 without any loss of information? 

(a) x[n] = S[n — /in], for no some unknown integer 

(b) x[n] — cos(7zn/4) 

(c) x[n] = cos(tt/i/4) + cos(3jrn/4) 
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4.15. 



(d) x[n] = sm(7rn/3)/(nn/3) 

(e) x[n] = (-1)" sm(7rn/3) /(jzn/3) 

Consider the system shown in Figure P4.15-1. For each of the following input signals x[n], 
indicate whether the output x r [n] — x[n]. 

(a) x[n] = cos(7in/4) 

(b) x[n] = cos(7in/2) 
(c) 



x[n] = 



sin(jr«/8) 



Tin 



Hint: Use the modulation property of the Fourier transform to find X(e^"). 




Figure P4.15-1 

4.16. Consider the system in Figure 4.28. The input x[n] and corresponding output x e i[n] are given 
for a specific choice of M( L in each of the following parts. Determine a choice for Mf L 
based on the information given, and specify whether your choice is unique. 

(a) x[n] = sin (tt/i/3) /(jtm/3). x ( i[n] = sin (5jTn/6) /(5jrn/6) 

(b) x[n] = cos(3jth/4) , ^[n] — cos(jt«/2) 

4.17. Each of the following parts lists an input signal x[n] and the upsampling and downsampling 
rates L and M for the system in Figure 4.28. Determine the corresponding output x ( i[n\. 

(a) x[n] = sin(2jin/3)/ Tin, L-4, M = 3 

(b) x[n] = sin(37r«/4), L = 3, M = 5 

4.18. For the system shown in Figure 4.28, X(e ,w ), the Fourier transform of the input signal 
x[n], is shown in Figure P4.18-1. For each of the following choices of L and M, specify the 
maximum possible value of coq such that X ( j(e J '") = aX(e }Mw/L ) for some constant a. 

X(en 




o» 



Figure P4.18-1 



(a) M = 3, L = 2 

(b) M = 5. L = 3 

(c) M=2, L = 3 

4.19. The continuous-time signal x c (t) with the Fourier transform X c (jQ) shown in Fig- 
ure P4.19-1 is passed through the system shown in Figure P4.19-2. Determine the range 
of values for T for which x r (t) = x c (t). 





-a, 



a r 



3 ° 



a, a 



Figure P4.19-1 



218 



Sampling of Continuous-Time Signals Chap. 4 





C/D 




D/C 






*c(0 


x[n] 


x r [n] 






\ 

T 


t 

T 


Figure P4. 19-2 



4.20. Consider the system in Figure 4,11. The input signal x c (t) has the Fourier transform shown 
in Figure P4.20-1 with Qq = 27r(1000) radians/second. The discrete-time system is an ideal 
lowpass filter with frequency response 



//(£?'") = 



1, \u>\ < iO c , 

0, otherwise. 



x(ja) 




-iln 



On 



a 



Figure P4.20-1 



(a) What is the minimum sampling rate F s = 1/ T such that no aliasing occurs in sampling 
the input? 

(b) If a> c = 7r/2, what is the minimum sampling rate such that y c (t) = x c (t)'~! 



Basic Problems 

4.21. A complex-valued continuous-time signal x c (t) has the Fourier transform shown in Fig- 
ure P4.21-1, where (0,2 — £2|) = AQ. This signal is sampled to produce the sequence 
x[n] — x c (nT). 



X c (jtt) 




th 



Dn 



ft 



Aft 



Figure P4.21-1 



(a) Sketch the Fourier transform X(e^ M ) of the sequence x[n] for T — ti j Q.2- 

(b) What is the lowest sampling frequency that can be used without incurring any aliasing 
distortion, i.e., so that x c (t) can be recovered from x[n\l 

(c) Draw the block diagram of a system that can be used to recover x c (t) from x[n] if the 
sampling rate is greater than or equal to the rate determined in Part (b). Assume that 
(complex) ideal filters are available. 

4.22. A continuous-time signal x c (t), with Fourier transform X c {j£l) shown in Figure P4.22-1, is 
sampled with sampling period T — 2tt/Qo to form the sequence x[n] = x c (nT). 
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x c un) 




-n, 



a 



a 



a, 



a 



Figure P4.22-1 



(a) Sketch the Fourier transform X(e^'°) for |a>| < tt. 

(b) The signal x[n] is to be transmitted across a digital channel. At the receiver, the original 
signal x c (t) must be recovered. Draw a block diagram of the recovery system and specify 
its characteristics. Assume that ideal filters are available. 

(c) In terms of Q^, for what range of values of 7 can x c (t) be recovered from x[/i]? 

4.23. In Figure P4.23-1, assume that X c (jQ) — 0, \Q\ > tt/T\. For the general case in which 
7, / 7 2 in the system, express y c (t) in terms of x c (t). Is the basic relationship different for 
7, > 7 2 and T\ < TV? 





cm 




D/C 






\-{t) 


x\n\ 


y ( .(/) 






\ 






Figure P4.23-1 



4.24. In the system of Figure P4.24-1, X c {jQ) and H(e j< ") are as shown. Sketch and label the 
Fourier transform of y c (r) for each of the following cases: 

(a) 1/7, = 1/7 2 = 1() 4 

(b) 1/T, = 1/T 2 = 2 x 10 4 

(c) 1/7, =2 x 10 4 , l/7 2 - 10 4 

(d) 1/7, = 10 4 , l/7 2 =2 x 10 4 



x c (t) 



C/D 



H(ei">) 



D/C 



T 

T 2 



v,(0 



x c W) 




-2tt x 5 X 10 3 2tt x 5 x 10 3 



n 



H(e^) 



TT CO 



Figure P4.24-1 
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4.25. Figure P4.25-1 shows the overall system for filtering a continuous-time signal using a 
discrete-time filter. The frequency responses of the reconstruction filter H r (jQ.) and the 
discrete-time filter H(e )ay ) are shown in Figure P4.25-2. 



C/D_ _ 
s(t)= + f 8(t-nT) 



D/C 



*<■(') 




*,(') 



Convert from 

impulse train 

to discrete-time 

sequence 



x\n] 



H(eJ">) 



y[n] 



Convert to 

impulse 

train 



XvtO 



Ideal 

reconstruction 

filter 

H r (jll) 



y r (0 



Figure P4.25-1 



5 X 10" s 



H r W) 



H(ei») 



2ttX 10 4 (1 _ 77 7T OJ 

4 4 Figure P4.25-2 

(a) For X c (jQ) as shown in Figure P4.25-3 and 1/ T = 20 kHz, sketch X,(jQ) and X(ei<"). 



xAm 




-2tt x io 4 277 x io 4 n Figure P4.25-3 

l 



-d, 



a 



(i 



Figure P4.25-4 



For a certain range of values of T, the overall system, with input x c (t) and output y c (t), 
is equivalent to a continuous-time lowpass filter with frequency response H e ff(jQ) 
sketched in Figure P4.25-4. 

(b) Determine the range of values of T for which the information presented in (a) is true 
when X c (jQ) is bandlimited to \Q\ <2tt x IO 4 as shown in Fig. P4.25-3. 

(c) For the range of values determined in (b), sketch £2 C as a function of 1/ T. 

Note: This is one way of implementing a variable-cutoff continuous-time filter using fixed 
continuous-time and discrete-time filters and a variable sampling rate. 

4.26. Consider the sequence x[n] whose Fourier transform X(e )(li ) is shown in Figure P4.26-1. 
Define 



x s [n] = 



x[n], n= Mk. fc = 0,±l,±2. 



0, 



otherwise. 



Chap. 4 Problems 



221 



and 



X(i\n\ = x 5 [M«] = jt[Mrt]. 



(a) Sketch X s (e joJ ) and X^e* 03 ) for each of the following cases: 
(i) M = 3,co H = 7i/2 

(ii) M = 3, co H = n/4- 

(b) What is the maximum value of cofj that will avoid aliasing when M — 3? 



X{ei") 




277 



Figure P4.26-1 



4.27. Using Parseval's theorem, briefly explain why the amplitude of the Fourier transform 
changes during downsampling but not during upsampling. 

4.28. (a) Is the system in Figure 4. 11 linear for a given choice of T ? If so, provide a brief argument 

demonstrating that it satisfies linearity. If not, provide a counterexample. 
(b) Is the system in Figure 4. 1 1 time invariant for a given choice of 77 If so, provide a brief 
argument demonstrating that it satisfies time invariance. If not, provide a counterex- 
ample. 

Advanced Problems 

4.29. Consider the systems shown in Figure P4.29-1. Suppose that H\{e )Q> ) is fixed and known. 
Find H2(ei 0) ), the frequency response of an LTI system, such that yity) = y\ [n] if the inputs 
to the systems are the same. 



x[n] 



t2 



*- H x {ei") 



\2 



yiH 



(a) 



x[n] 



H 2 (e 



JlO\ 



(b) 



>'2M 



Figure P4.29-1 



4.30. In the system of Figure 4.11, assume that the discrete-time system is linear and time invariant 
and that X c (jQ) = for \Q\ > 40007T. Determine the largest possible value for T and the 
corresponding frequency response H(e ja} ) for the discrete-time system such that 



Y c (jQ) = 



\Q\X c (jQ). IOOOtt < \Q\ < 2000TT. 
0. otherwise. 



4.31. In the system of Figure 4.11, assume that X c (jQ) — for |J3| > tc/T. Determine and plot 
the magnitude and phase of the frequency response of the discrete-time LTI system such 
that the output y r (t) is the running integral of the input, i.e., 

y r (t)= / x c (r)dT. 
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4.32. A bandlimited continuous-time signal is known to contain a 60-Hz component, which we 
want to remove by processing with the system of Figure 4.11, where T = 10 -4 . 

(a) What is the highest frequency that the continuous-time signal can contain if aliasing is 
to be avoided? 

(b) The discrete-time system to be used has frequency response 

Hie jo> ) = — [ ~ — ^- — ] - — 

[1 -0.9<? -J(«-«o)][l - O.9e-ti (0+<0 ^] 

Sketch the magnitude and phase of H{e^). 

(c) What value should be chosen for coq to eliminate the 60-Hz component? 

4.33. Consider the system in Figure 4.11 with X c (jQ) = for \Q\ > 2^(1000) and the discrete- 
time system a squarer, i.e.. y[n] = x 2 [n]. What is the largest value of T such that y c (t) = 

4.34. For the LTI system in Figure P4.34- 1 , 

H{e jai ) = e~ iu>12 . \<d\ < n (half-sample delay). 



x[n] 



H(e^) 



yW Figure P4.34-1 



(a) Determine a choice for T and h c (t) in the system of Figure 4.16 so that the system in 
Figure P4.34-1 with H(e^) as specified is equivalent to the system in Figure 4.16. 

(b) Determine and sketch y[n] when the input sequence is 



x[n] = cos ( — - 



as sketched in Figure P4.34-2. 



5tt tt 

n — - 
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Figure P4.34-2 



4.35. Consider the system of Figure 4.16 with the continuous-time LTI system causal and char- 
acterized by the linear constant-coefficient differential equation 

The overall system is equivalent to a causal discrete-time LTI system. Determine the fre- 
quency response H{e^) of the equivalent discrete-time system when T = 0.1s. 

4.36. In Figure P4.36-1, x[n] = x c (nT) and y[n] = x[2n]. 

(a) Assume that x c (t) has a Fourier transform such that X c (jQ) = 0, \Q\ > 2^(100). What 
value of T is required so that 



X(e ico ) = 0, 



— < \a> \ < n I 
2 
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(b) How should T be chosen so that y c (t) — x c (t)' 



x c (t) 



C/D 



x[n] 



\2 



y[n] 



D/C 



J 

T 



y c (0 



Figure P4.36-1 



4.37. Suppose that you obtained a sequence s [n] by filtering a speech signal s c (t ) with a continuous- 
time lowpass filter with a cutoff frequency of 5 kHz and then sampling the resulting output 
at a 10-kHz rate, as shown in Figure P4.37-1. Unfortunately, the speech signal s c (t) was 
destroyed once the sequence s[n] was stored on magnetic tape. Later, you find that what 
you should have done is followed the process shown in Figure P4.37-2. Develop a method to 
obtain S] [n] from s [n] using discrete-time processing. Your method may require a very large 
amount of computation, but should not require a C/D or D/C converter. If your method 
uses a discrete-time filter, you should specify the frequency response of the filter. 
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Figure P4.37-1 
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4.38. Consider the system shown in Figure P4.38-1, where 

1, \co\ < 7T/L, 

0, 7i /L < \co\ < jr. 

Sketch Y c (jQ) if X c (jS2) is as shown in Figure P4.38-2. 



H{e joy ) = 



Figure P4.37-2 




x c (t) 



{-\) -e> T'=T/L 



Figure P4.38-1 

XcUO) 




Figure P4.38-2 
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4.39. The system shown in Figure P4.39-1 approximately interpolates the sequence x[n] by a 
factor L. Suppose that the linear filter has impulse response h[n] such that h[n] = h[— n] 
and h[n] = for \n\ > (RL — 1), where R and L are integers; i.e., the impulse response is 
symmetric and of length (2RL - 1) samples. 



x[n] 



\L 



v[n] 



H{ei») 



yi n ) Figure P4.39-1 



(a) In answering the following, do not be concerned about the causality of the system; it can 
be made causal by including some delay. Specifically, how much delay must be inserted 
to make the system causal? 

(b) What conditions must be satisfied by h[n) in order that y[n] — x[n/ L] for n — 0, ±L, 
±2L,±3L,...? 

(c) By exploiting the symmetry of the impulse response, show that each sample of y[n] can 
be computed with no more than RL multiplications. 

(d) By taking advantage of the fact that multiplications by zero need not be done, show 
that only 2R multiplications per output sample are required. 

4.40. In the system of Figure P4.40-1, 

X c (jQ) = Q, \Q\>tt/T. 

and 



0, 71 1 L < |a>| < 71. 

How is y[n] related to the input signal x c (t)l 



*c(0 



C/D 



x[n]=x c (nT) 



\L 



H(e)<») 



\L 



y[»] 



T Figure P4.40-1 

4.41. Consider the system shown in Figure P4.41-1. The input to this system is the bandlimited 
signal whose Fourier transform is shown in Figure P4.20-1 with £2o = n/ T. The discrete-time 
LTI system in Figure P4.41-1 has the frequency response shown in Figure P4.41-2. 




Figure P4.41-1 
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Figure P4.41-2 
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(a) Sketch the Fourier transforms X(e^), X e (e^), Y e {e)° r ), and Y c (jQ). 

(b) For the general case when X c (jQ) — for |£2| > tt/T, express Y c (jQ) in terms of 
X c (jQ). Also, give a general expression for y c (t) in terms of x c (t) when x c (t) is band- 
limited in this manner. 

4.42. Let x c (t) be a real-valued continuous-time signal with highest frequency 2jt(250) radi- 
ans/second. Furthermore, let y c (t) = x c (t — 1/1000). 

(a) If x[n] = x c (n/5Q0), is it theoretically possible to recover a<(/) from x[n]? Justify your 
answer. 

(b) If y[n] — y c (n/ 500), is it theoretically possible to recover y c (t) from >'[/?]? Justify your 
answer. 

(c) Is it possible to obtain y[n] from x[n] using the system in Figure P4.42- 1 ? If so, determine 
Hiiei' ). 

(d) It is also possible to obtain y[n] from x[n] without any upsampling or downsampling 
using a single LTI system with frequency response Ih{ e ' a ')- Determine Hzie-'*"). 



x[n] 



u 



H x {en 
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-*- v n 



Figure P4.42-1 



4.43. Consider the system shown in Figure P4.43-1 for discrete-time processing of the continuous- 
time input signal &■(/). The input signal g c (t) is of the form g c (t) = f[(t) + e c (t)< where the 
Fourier transforms of f c (t) and ^(0 are shown in Figure P4.43-2. Since the input signal is 
not bandlimited, a continuous-time antialiasing filter // aa (/£2) is used. The magnitude of 
the frequency response for H iyA (jQ) is shown in Figure P4.43-3. and the phase response of 
the antialiasing filter is lH iiti (j'Q) = ~Q ? . 
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Figure P4.43-1 
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(a) If the sampling rate is 2n/ T = 1600jt, determine the magnitude and phase of //(e ;w ), 
the frequency response of the discrete-time system, so that the output is y c (t) — f c {t). 

(b) Is it possible that y c (t) = f c (t) if Inj T < 1600tt? If so, what is the minimum value of 
In I 77 Determine H{e^) for this choice of 2tt/ T. 

4.44. Consider the system given in Figure P4.44-1. You may assume that R c (j£l) is bandlimited; 
i.e., Rc(jQ) = 0, \Q\ > 2^(1000), as shown in the figure. 
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Figure P4.44-1 

(a) Sketch R (<?' w ) and X{e iw ). 

(b) Choose nonzero values for coo and 7? such that 

y[n] = ar t (nT 2 ) 

for some nonzero constant a. (You do not have to determine the value of a.) 

(c) Using the value of a>o you obtained in Part (b), determine a choice for 7^ such that 

s c (t) = fir c (t) 

for some nonzero constant ft. (You do not have to determine the value of ft.) 

4.45. Assume that the continuous-time signal x c (t) in Figure P4.45-1 is exactly bandlimited and 
exactly time limited so that 

x c (t) = for t < and t > 10 seconds 

and 

X c (jSl) = for \n\ >2tt x 10 4 . 

While no continuous-time signal can be exactly bandlimited and time limited, the assump- 
tion that a signal satisfies both constraints often an excellent approximation and one that 
we typically rely on in discrete-time processing of continuous-time signals. The continuous- 
time signal x c (t) is sampled as indicated in Figure P4.45-1 to obtain the sequence x[n], 
which we want to process to estimate the total area A under * c (0 as precisely possible. 
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Figure P4.45-1 
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Specifically, we define 



10 



A= / x c {t)dt. 
Jo 
Specify a choice for the impulse response h[n] for the discrete-time system and the largest 
possible value of T to obtain as accurate an estimate as possible of A. State specifically 
whether your estimate will be exact or approximate. 

4.46. Consider the system in Figure P4.46-1 with Hq(z), H\ (z), and H 2 (z) as the system functions 
of LTI systems. Assume that x[n] is an arbitrary stable complex signal without any symmetry 
properties. 
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Figure P4.46-1 

(a) Let Hq(z) = 1, Hi(z) = z -1 , and H 2 (z) = z~ 2 . Can you reconstruct x[n] from ^o[«], 
_yi[«], and ^M? If so, how? If not, justify your answer. 

(b) Assume that H (e ja) ), H\{e j(0 ), and H 2 (e i<0 ) are as follows: 



Hden = 
H 2 (en - 



1, M<tt/3, 

0, otherwise, 

1, jt/3 < M < 2jt/3, 

0, otherwise, 

1, 2JT/3 < |CU| < 77, 

0, otherwise. 



Can you reconstruct x[n) from yo[n], y\[n], and y2M? If so, how? If not, justify your 

answer. 
Now consider the system in Figure P4.46-2. Let H^(e J<i> ) and H 4 {e^) be the frequency 
responses of the LTI systems in this figure. Again, assume that x[n] is an arbitrary stable 
complex signal with no symmetry properties. 
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Figure P4.46-2 



(c) Suppose that H 3 (e jw ) = 1 and 



H 4 (e j n = 



1, < CO < JT, 



-1, — 71 < CO < 0. 

Can you reconstruct x[n] from y?\n\ and ^4[«]? If so, how? If not, justify your answer. 
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Extension Problems 

4.47. In many applications, discrete-time random signals arise through periodic sampling of 
continuous-time random signals. We are concerned in this problem with a derivation of 
the sampling theorem for random signals. Consider a continuous-time, stationary, random 
process defined by the random variables [Xa(t)}, where / is a continuous variable. The 
autocorrelation function is defined as 

0. Vf , i (r) = < f{A-(/)x*(/ + r)}. 

and the power density spectrum is 

P XrXl .(to)= / 0,,.v,(r)e-'' QT </r. 



A discrete-time random process obtained by periodic sampling is defined by the set of 
random variables {*[«]}, where x[n] — x a (nT) and T is the sampling period. 

(a) What is the relationship between <p X x[n] and <f> XcXt (r)? 

(b) Express the power density spectrum of the discrete-time process in terms of the power 
density spectrum of the continuous-time process. 

(c) Under what condition is the discrete-time power density spectrum a faithful represen- 
tation of the continuous-time power density spectrum? 

4.48. Consider a continuous-time random process jc c (/) with a bandlimited power density spec- 
trum P Xi . Xr (Q) as depicted in Figure P4.48-1. Suppose that we sample x c (t) to obtain the 
discrete-time random process x[n] = x c (nT). 



p XcXc m 



-a 



a 



n 



Figure P4.48-1 



(a) What is the autocorrelation sequence of the discrete-time random process? 

(b) For the continuous-time power density spectrum in Figure P4.48-1, how should T be 
chosen so that the discrete-time process is white, i.e., so that the power spectrum is 
constant for all of! 

(c) If the continuous-time power density spectrum is as shown in Figure P4.48-2, how 
should T be chosen so that the discrete-time process is white? 
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Figure P4.48-2 



(d) What is the general requirement on the continuous-time process and the sampling 
period such that the discrete -time process is white? 
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4.49. This problem explores the effect of interchanging the order of two operations on a signal, 
namely, sampling and performing a memoryless nonlinear operation. 
(a) Consider the two signal-processing systems in Figure P4.49-1, where the C/D and D/C 
converters are ideal. The mapping g[x] — x 2 represents a memoryless nonlinear device. 
For the two systems in the figure, sketch the signal spectra at points 1, 2, and 3 when 
the sampling rate is selected to be 1/ T = 2/„, Hz and x c (t ) has the Fourier transform 
shown in Figure P4.49-2. Is vi(0 = ^(0? If not. why not? Is vi(/) = x 2 (t)'? Explain 
your answer. 
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Figure P4.49-1 
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Figure P4.49-2 



(b) Consider System l,andletx(r) = A cos(307rr). Let the sampling rate be 1/ T = 40 Hz. 
Is yi(t) = x 2 (t)? Explain why or why not. 

(c) Consider the signal-processing system shown in Figure P4.49-3, where g[x] = x 3 and 
g -1 [u] is the (unique) inverse, i.e., ^ _1 [^( x )] — A '- L et x (0 — -4cos (30jrf) and 1/T — 
40 Hz. Express v[n] in terms of x[n]. Is there spectral aliasing? Express y[n] in terms of 
x[n]. What conclusion can you reach from this example? You may find the following 
identity helpful: 

cos 3 £V = \ cos Q{)t + | cos3£2o?. 
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(d) One practical problem is that of digitizing a signal having a large dynamic range. Sup- 
pose we compress the dynamic range by passing the signal through a memoryless non- 
linear device prior to A/D conversion and then expand it back after A/D conversion. 
What is the impact of the nonlinear operation prior to the A/D converter in our choice 
of the sampling rate? 

4.50. Figure 4.24 depicts a system for interpolating a signal by a factor of L, where 



x e [n] = 



x[nfL\. n = 0, ±L. ±2L , etc 
0, otherwise. 



and the lowpass filter interpolates between the nonzero values of x c [n] to generate the 
upsampled or interpolated signal Xj[n]. When the lowpass filter is ideal, the interpolation is 
referred to as bandlimited interpolation. As indicated in Section 4.6.2, simple interpolation 
procedures are adequate in many applications. Two simple procedures often used are zero- 
order-hold and linear interpolation. For zero-order-hold interpolation, each value of x[n] 
is simply repeated L times; i.e.. 



*,[0]. 
f x e [L], 
*i[n] = < x e [2L], 



« = 0, 1 L 

n= L. L+l... 
n = 2L, 2L+1. 



2L- 1 



Linear interpolation is described in Section 4.6.2. 

(a) Determine an appropriate choice for the impulse response of the lowpass filter in 
Figure 4.24 to implement zero-order-hold interpolation. Also, determine the corre- 
sponding frequency response. 

(b) Equation (4.92) specifies the impulse response for linear interpolation. Determine the 
corresponding frequency response. (You may find it helpful to use the fact that /rii n [«] 
is triangular and consequently corresponds to the convolution of two rectangular se- 
quences.) 

(c) Sketch the magnitude of the filter frequency response for zero-order-hold and linear 
interpolation. Which is a better approximation to ideal bandlimited interpolation? 

4.51. We wish to compute the autocorrelation function of an upsampled signal, as indicated in 
Figure P4.51-1. It is suggested that this can equivalently be accomplished with the system of 
Figure P4.51-2. Can H2(e' a} ) be chosen so that <j>3,[n] = <j>\ [«]? If not, why not? If so, specify 
H 2 (e JW ). 
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Figure P4. 51-1 
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Figure P4.51-2 



4.52. We are interested in upsampling a sequence by a factor of 2, using a system of the form of 
Figure 4.24. However, the lowpass filter in that figure is to be approximated by a five-point 
filter with impulse response h[n] indicated in Figure P4.52-1 . In this system, the output y\ [n] 
is obtained by direct convolution of h[n] with w[n]. 
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Figure P4.52-1 



(a) A proposed implementation of the system with the preceding choice of h[n] is shown 
in Figure P4.52-2. The three impulse responses h\[n], hi[n], and hi[n] are all restricted 
to be zero outside the range < n < 2. Determine and clearly justify a choice for 
hi[n], hi[n], and hj[n] so that y\[n] = V:["] for any x[n], i.e., so that the two systems 
are identical. 
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Figure P4.52-2 



(b) Determine the number of multiplications per output point required in the system of 
Figure P4.52-1 and in the system of Figure P4.52-2. You should find that the system of 
Figure P4.52-2 is more efficient. 

4.53. Consider the analysis-synthesis system shown in Figure P4.53-1. The lowpass filter /io[/?] 
is identical in the analyzer and synthesizer, and the highpass filter h\[n] is identical in the 
analyzer and synthesizer. The Fourier transforms of ho[n] and hi [n] are related by 
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(a) If X(e ja} ) and Ho(e }co ) are as shown in Figure P4.53-2, sketch (to within a scale factor) 
X Q (en, G (en, and Y (e^). 

(b) Write a general expression for Go(e ;w ) in terms of X(e ita ) and Ho(e ja) ), Do not assume 
that X(e ja} ) and Ho(e joJ ) are as shown in Figure 4.53-2. 




H (eh 



-2tt 
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Figure P4.53-2 



(c) Determine a set of conditions on Ho(e J ™) that is as general as possible and that will 

guarantee that y[n] is proportional to x[n — rid] for any stable input x[ri\. 
Note: Analyzer-synthesizer filter banks of the form developed in this problem are very 
similar to quadrature mirror filter banks. For further reading, see Crochiere and Rabiner 
(1983), pp. 378-392. 

4.54. Consider a real- valued sequence x[n] for which 



X{e j0} ) = 0, 



-<\a>\< n. 



One value of x[n] may have been corrupted, and we would like to approximately or exactly 
recover it. With x[n] denoting the corrupted signal, 

x[n] = x[n] for n / mq, 

and x[no] is real but not related to x[no]. In each of the following three cases, specify a 
practical algorithm for exactly or approximately recovering x[n] from x[ri\: 

(a) The value of no is known. 

(b) The exact value of i\q is not known, but we know that «o is an even number. 

(c) Nothing about no is known. 

4.55. Communication systems often require conversion from time-division multiplexing (TDM) 
to frequency-division multiplexing (FDM). In this problem, we examine a simple example 
of such a system. The block diagram of the system to be studied is shown in Figure P4.55-1. 
The TDM input is assumed to be the sequence of interleaved samples 



w[ri\ = 



*i[«/2] 
x 2 [(n - l)/2] 



for n an even integer, 
for n an odd integer. 



Assume that the sequences x\[n] = x c \(nT) and X2[ri\ = x C 2(nT) have been obtained 
by sampling the continuous-time signals * cl (f) and x C 2(t), respectively, without aliasing. 
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Figure P4.55-1 



Assume also that these two signals have the same highest frequency, Qn, and that the 

sampling period is T — tt/Qn- 

(a) Draw a block diagram of a system that produces x\ [n] and X2[n] as outputs; i.e., obtain 

a system for demultiplexing a TDM signal using simple operations. State whether or 

not your system is linear, time invariant, causal, and stable. 

The kxh modulator system (k = 1 or 2) is denned by the block diagram in Figure P4.55-2. 
The lowpass filter H, (e ;V "), which is the same for both channels, has gain L and cutoff fre- 
quency it/L, and the highpass filters H k {e^ w ) have unity gain and cutoff frequency cou- The 
modulator frequencies are such that 



<*>2 = Ct)\ + 71 1 L 



and 



<^2 + 71 J L < 71 



(assume co\ > tt/2). 
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Figure P4.55-2 



(b) Assume that Qjv = 2jt x 5 x 10 3 . Find cl>i and L so that, after ideal D/C conversion 
with sampling period T/L, the Fourier transform of y c (t) is zero, except in the band of 
frequencies 

In x 10 5 < M < 2tt x 10 5 + 2Q.V. 



^dO'ft) 




^ c2 0'fi) 




Figure P4.55-3 



(c) Assume that the continuous-time Fourier transforms of the two original input signals 
are as sketched in Figure P4.55-3. Sketch the Fourier transforms at each point in the 
system. 

(d) Based on your solution to Parts (a)-(c), discuss how the system could be generalized 
to handle M equal-bandwidth channels. 

4.56. In Section 4.8.1, we considered the use of prefiltering to avoid aliasing. In practice, the 
antialiasing filter cannot be ideal. However, the nonideal characteristics can be at least 
partially compensated for with a discrete-time system applied to the sequence x[n] that is 
the output of the C/D converter. 
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Consider the two systems in Figure P4.56-1. The antialiasing filters H[dea\(jQ) and 
H aa (jQ.) are shown in Figure P4.56-2. H(e^) in Figure P4.56-1 is to be specified to com- 
pensate for the nonideal characteristics of H aa (jQ). 

Sketch H{e )w ) so that the two sequences x[n] and w[n] are identical. 
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Figure P4.56-1 
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Figure P4.56-2 



4.57. As discussed in Section 4.8.2, to process sequences on a digital computer, we must quantize 
the amplitude of the sequence to a set of discrete levels. This quantization can be expressed 
in terms of passing the input sequence x[n] through a quantizer Q(x) that has an input- 
output relation as shown in Figure 4.48. 

As discussed in Section 4.8.3, if the quantization interval A is small compared with 
changes in the level of the input sequence, we can assume that the output of the quantizer 
is of the form 

y[n] = x[n] -h e[n], 

where e[n] = Q (x[n]) — x[n] and e[n] is a stationary random process with a first-order prob- 
ability density uniformly distributed between — A/2 and A/2, uncorrelated from sample to 
sample and uncorrelated with x[n], so that £{e[w].x|m]} = for all m and n. 

Let x[n] be a stationary white-noise process with zero mean and variance o^. 

(a) Find the mean, variance, and autocorrelation sequence of e[n]. 

(b) What is the signal-to-quantizing-noise ratio ol/o^l 

(c) The quantized signal y[n] is to be filtered by a digital filter with impulse response 
h[n] = ^[a n 4- (-a)' 1 ]w[rt]. Determine the variance of the noise produced at the output 
due to the input quantization noise, and determine the signal-to-noise ratio at the 
output. 
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In some cases we may want to use nonlinear quantization steps, for example, logarithmically 
spaced quantization steps. This can be accomplished by applying uniform quantization to 
the logarithm of the input as depicted in Figure P4.57-1, where Q[] is a uniform quantizer 
as specified in Figure 4.48, In this case, if we assume that A is small compared with changes 
in the sequence ln(x[/i]), then we can assume that the output of the quantizer is 



\n(y[n]) = \n(x[n]) + e[n]. 



Thus, 



y[n] = x[n] ■ exp(e[n]). 
For small e, we can approximate exp(e[«]) by (1 + e[n]), so that 

y[n] « *[fi](1 + e[n]) = x[n] + /[«]. 



(P4.57) 



This equation will be used to describe the effect of logarithmic quantization. We assume 
e[n] to be a stationary random process, uncorrelated from sample to sample, independent 
of the signal x[n], and with first-order probability density uniformly distributed between 

±A/2. 
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Figure P4.57-1 



(d) Determine the mean, variance, and autocorrelation sequence of the additive noise f[n] 
defined in Eq. (P4.57). 

(e) What is the signal-to-quantizing-noise ratio o^fo 1 ^ Note that in this case o^/a J is inde- 
pendent of <7j . Within the limits of our assumption, therefore, the signal-to-quantizing- 
noise ratio is independent of the input signal level, whereas, for linear quantization, the 
ratio (J^/cTg depends directly on a\. 

(f ) The quantized signal y[n] is to be filtered by means of a digital filter with impulse 
response h[n] = \[a n + (— a)"]w[/?]. Determine the variance of the noise produced at 
the output due to the input quantization noise, and determine the signal-to-noise ratio 
at the output. 

4.58. Figure P4.58-1 shows a system in which two continuous-time signals are multiplied and 
a discrete-time signal is then obtained from the product by sampling the product at the 
Nyquist rate; i.e., y\[n] is samples of y c (t) taken at the Nyquist rate. The signal x\(t) is 
bandlimited to 25 kHz (Xi(jn) = for |fi| > 5tz x 10 4 ), and x 2 (t) is limited to 2.5 kHz 
(X 2 UQ) = for \n\ > (tt/2) x 10 4 ). 
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Figure P4.58-1 



In some situations (digital transmission, for example), the continuous-time signals have 
already been sampled at their individual Nyquist rates, and the multiplication is to be 
carried out in the discrete-time domain, perhaps with some additional processing before 
and after multiplication, as indicated in Figure P4.58-2. Each of the systems A, B, and C 
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either is an identity or can be implemented using one or more of the modules shown in 
Figure P4.58-3. 
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Figure P4.58-3 

For each of the three systems A, B, and C, either specify that the system is an identity 
system or specify an appropriate interconnection of one or more of the modules shown in 
Figure P4.58-3. Also, specify all relevant parameters L, M, and co c . The systems A, B, and 
C should be constructed such that yi[n\ is proportional to y\ [n], i.e., 

yiln] — ky\[n] = ky c {nT) = kx\(nT) x X2(nT), 

and these samples are at the Nyquist rate, i.e., y2[«] does not represent oversampling or 
undersampling of y c (t). 

4.59. Suppose s c (t) is a speech signal with the continuous-time Fourier transform S c (jQ) shown 
in Figure P4.59-1. We obtain a discrete-time sequence s r [n] from the system shown in 
Figure P4.59-2, where H(e }0J ) is an ideal discrete-time lowpass filter with cutoff frequency 
a> c and a gain of unity throughout the passband, as shown in Figure 2.17. The signal s r [n] 
will be used as an input to a speech coder, which operates correctly only on discrete-time 
samples representing speech sampled at an 8-kHz rate. Choose values of L , M, and co c that 
produce the correct input signal s r [n] for the speech coder. 
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Figure P4.59-2 

4.60. In many audio applications, it is necessary to sample a continuous-time signal x c (t) at 
a sampling rate \/T — 44 kHz. Figure P4.60-1 shows a straightforward system, includ- 
ing a continuous-time antialias filter H a o(jQ), to acquire the desired samples. In many 
applications, the "4x oversampling" system shown in Figure P4.60-2 is used instead of the 
conventional system shown in Figure P4.60-1. In the system in Figure P4.60-2, 



H(e ia >) = 



1. \(0\ < 7T/4, 

0, otherwise, 
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x c (t) 



n aX (m 



C/D 



H(ei u ) 



\a 



x[n] 



(1/D = 4 x 44 kHz = 176 kHz 



Figure P4.60-2 



Assuming that H(e^) is ideal, find the minimal set of specifications on the antialias 
filter H a i(jQ), i.e., the smallest Q p and the largest Q s , such that the overall system of 
Figure P4.60-2 is equivalent to the system in Figure P4.60-1. 

4.61. In this problem, we will consider the "double integration" system for quantization with 
noise shaping shown in Figure 4.61-1. In this system, 



Hy{z) = 



1 



and H 2 (z) = 



1-z- 1 "^' 1-z- 1 ' 

and the frequency response of the decimation filter is 



H 3 (en = 



1, \<d] < 7lf M, 

0, Ti J M < \co\ < 71. 
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The noise source e[n], which represents a quantizer, is assumed to be a zero-mean white- 
noise (constant power spectrum) signal that is uniformly distributed in amplitude and has 
noise power o' e 



- 2 = A 2 /12. 



e[n] 



>(?) *- tfi(z) */^) 

*[»] yr^n] | | V[n) yfd 2 [n 



H 2 {z) 



u[n] 



o 



v[«] 



HM 



w[n] 



\ M 



v[n] - w[Mn] 



Figure P4.61-1 

(a) Determine an equation for Y(z) in terms of X{z) and E(z). Assume for this part that 
E(z) exists. From the z-transform relation, show that y[n] can be expressed in the form 
y[n] = x[n — 1] + /[«], where f[n] is the output due to the noise source e[n\. What is 
the time-domain relation between f[n] and e[n\1 

(b) Now assume that e[n] is a white-noise signal as described prior to Part (a). Use the 
result from Part (a) to show that the power spectrum of the noise f[n] is 

P ff (e it0 ) = 16a 2 sinV/2). 



What is the total noise power (aj) in the noise component of the signal y[n]'? On the 
same set of axes, sketch the power spectra P^(e^ w ) and Pff(e^") for < to < tt. 

(c) Now assume that X(e JC ") = for tt/ M < co < tt. Argue that the output of H^iz) is 
w[n] = x[n — 1] + g[n]. State in words what g[n] is. 

(d) Determine an expression for the noise power o^ at the output of the decimation filter. 
Assume that tt/ M <<C tt , i.e., M is large, so that you can use a small-angle approximation 
to simplify the evaluation of the integral. 

(e) After the decimator, the output is v[n] — w[Mn] — x[Mn — 1] + q[n], where q[n\ = 
g[Mn\. Now suppose that x[n] = x c (nT) (i.e., x[n] was obtained by sampling a 
continuous-time signal). What condition must be satisfied by X c (jQ) so that x[n — 1] 
will pass through the filter unchanged? Express the "signal component'' of the output 
v[n] in terms of x c (t). What is the total power of of the noise at the output? Give an 
expression for the power spectrum of the noise at the output, and, on the same set of 
axes, sketch the power spectra P ee {e !aj ) and P (fq (e J ' (i) ) for < to < tt. 

4.62. For sigma-delta oversampled A/D converters with high-order feedback loops, stability 
becomes a significant consideration. An alternative approach referred to as MASH achieves 
high-order noise shaping with only first-order feedback. The structure for second-order 
MASH noise shaping is shown in Figure P4.62-2 and analyzed in this problem. 

Figure P4.62-1 is a first-order sigma-delta (Z — A) noise shaping system, where the 
effect of the quantizer is represented by the additive noise signal e[n]. The noise e[n] is 
explicitly shown in the diagram as a second output of the system. Assume that the input 
x[n] is a zero-mean wide-sense stationary random process. Assume also that e[n] is zero- 
mean, white, wide-sense stationary, and has variance of. e[n] is uncorrelated with x[n]. 
(a) For the system in Figure P4.62-1, the output y[n] has a component y x [n] due only to 

x[n] and a component y e [n] due only to e[n], i.e., y[n] — y x [n] + y e [n]. 

(i) Determine y x [n] in terms of x[n], 

(ii) Determine P Ve (a>), the power spectral density of y € [ri\. 
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Figure P4.62-1 
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+ " 



-0 



r\n] 
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Figure P4.62-2 



(b) The system of Figure P4.62-1 is now connected in the configuration shown in Fig- 
ure P4.62-2, which shows the structure of the MASH system. Notice that e\[n] and 
ei[n] are the noise signals resulting from the quantizers in the sigma-delta noise shap- 
ing systems. The output of the system r[n] has a component r x [n] due only to x[n], and 
a component r c \n] due only to the quantization noise, i.e., r[n] = r x [n] + r c [n]. Assume 
that f] [n] and e2[n] a re zero-mean, white, wide-sense stationary, each with variance a}. 
Also assume that e\ [n] is uncorrelated with ^["J- 
(i) Determine r x [n\ in terms of x[n\. 
(ii) Determine /*,-,, (^X the power spectral density of r e [n\. 
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Transform analysis of 
linear time-invariant 

SYSTEMS 



5.0 INTRODUCTION 

In Chapter 2 we developed the Fourier transform representation of discrete -time signals 
and systems, and in Chapter 3 we extended that representation to the z-transform. In 
both chapters, the emphasis was on the transforms and their properties, with only a 
brief preview of the details of their use in the analysis of linear time -invariant (LTI) 
systems. In this chapter, we develop in more detail the representation and analysis of 
LTI systems using the Fourier and z-transforms. The material is essential background 
for our discussion in Chapter 6 of the implementation of LTI systems and in Chapter 7 
of the design of such systems. 

As developed in Chapter 2, an LTI system can be completely characterized in the 
time domain by its impulse response h[n], with the output y[n] due to a given input x[n] 
specified through the convolution sum 

oo 

y[n] = x[n] * h[n] = J^ jc[/c]/i[n — k]. (5.1) 

k=— oo 

Alternatively, as discussed in Section 2.7, since the frequency response and impulse 
response are directly related through the Fourier transform, the frequency response, 
assuming it exists (i.e., converges), provides an equally complete characterization of LTI 
systems. In Chapter 3 we developed the z-transform as a generalization of the Fourier 
transform, and we showed that Y(z), the z- transform of the output of an LTI system, is 
related to X(z), the z- transform of the input, and H(z), the z- transform of the system 
impulse response, by 

Y(z) = H(z)X(z), (5.2) 

240 
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with an appropriate region of convergence. H(z) is referred to as the system function. 
Since the z-transform and a sequence form a unique pair, it follows that any LTI system 
is completely characterized by its system function, again assuming convergence. 

As we will see in this chapter, both the frequency response and the system function 
are extremely useful in the analysis and representation of LTI systems, because we can 
readily infer many properties of the system response from them. 



5.1 THE FREQUENCY RESPONSE OF LTI SYSTEMS 

The frequency response H(e }w ) of an LTI system was defined in Section 2.6 as the 
complex gain (eigenvalue) that the system applies to the complex exponential input 
(eigenfunction) e' imn . Furthermore, in Section 2.9.6 we developed the fact that, since the 
Fourier transform of a sequence represents a decomposition as a linear combination 
of complex exponentials, the Fourier transforms of the system input and output are 
related by 

Y(e JCO ) = H(e ia} )X(e jw ), (5.3) 

where X{e^) and Y(e }< °) are the Fourier transforms of the system input and output, 
respectively. With the frequency response expressed in polar form, the magnitude and 
phase of the Fourier transforms of the system input and output are related by 

\Y(en\ = \H{en\-\X(eni (5.4a) 

<Y(e>°) = <H(e j(V ) + <X(e ito ). (5.4b) 

| H(e j(V )\ is referred to as the magnitude response or the gain of the system, and <H(e> w ) 
is referred to as the phase response or phase shift of the system. 

The magnitude and phase effects represented by Eqs. (5.4a) and (5.4b) can be 
either desirable, if the input signal is modified in a useful way, or undesirable, if the 
input signal is changed in a deleterious manner. In the latter case, we often refer to 
the effects of an LTI system on a signal, as represented by Eqs. (5.4a) and (5.4b), as 
magnitude and phase distortions, respectively. 



5.1.1 Ideal Frequency-Selective Filters 

An important implication of Eq. (5.4a) is that frequency components of the input are 
suppressed in the output if \H(e^ w )\ is small at those frequencies. Whether this sup- 
pression of Fourier components is viewed as desirable or undesirable depends on the 
specific problem. Example 2.19 formalized the general notion of frequency-selective 
filters through the definition of certain ideal frequency responses. For example, the 
ideal lowpass filter was defined as the discrete-time linear time-invariant system whose 
frequency response is 

HUe'') = (l: W< ,^ (5.5) 
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and, of course, H\ p (e }0} ) is also periodic with period 2tt. The ideal lowpass filter selects 
the low-frequency components of the signal and rejects the high-frequency components. 
The corresponding impulse response was shown in Example 2.22 to be 

sin co c n 

h\ p [n\ = , — oo < n < oo. (5.6) 

Tin 

Analogously, the ideal highpass filter is defined as 

H hp (en={°; |a,|< . a '- (5.7) 

and since H^e^) = 1 — H\ p {e^), its impulse response is 

h hp [n] = 8[n] - h lp [n] = S[n] - 5E^. (5.8) 

Tin 

The ideal highpass filter passes the frequency band co c < co < n undistorted and rejects 
frequencies below co c . Other ideal frequency-selective filters were defined in Exam- 
ple 2.19. 

The ideal lowpass filters are noncausal, and their impulse responses extend from 
— oo to +oo. Therefore, it is not possible to compute the output of either the ideal 
lowpass or the ideal highpass filter either recursively or nonrecursively; i.e., the systems 
are not computationally realizable. 

Another important property of the ideal lowpass filter as defined in Eq. (5.5) is 
that the phase response is specified to be zero. If it were not zero, the low-frequency 
band selected by the filter would also have phase distortion. It will become clear later 
in this chapter that causal approximations to ideal frequency-selective filters must have 
a nonzero phase response. 

5.1.2 Phase Distortion and Delay 

To understand the effect of the phase of a linear system, let us first consider the ideal 
delay system. The impulse response is 

hid[n] = 8[n-n d ], (5.9) 

and the frequency response is 

H id (en = e-> a,n ' i , (5.10) 

or 

l#id(Ol = l, (5.Ha) 

<H ld (e ia} ) - -<»n d , \<o\ < it, (5.11b) 

with periodicity 2tz in oo assumed. For now, we will assume that n^ is an integer. 

In many applications, delay distortion would be considered a rather mild form 
of phase distortion, since its effect is only to shift the sequence in time. Often this 
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would be inconsequential, or it could easily be compensated for by introducing delay 
in other parts of a larger system. Thus, in designing approximations to ideal filters and 
other linear time-invariant systems, we frequently are willing to accept a linear phase 
response rather than a zero phase response as our ideal. For example, an ideal lowpass 
filter with linear phase would be defined as 

H ^ e Mo, co c < H < it. (5 ' 12) 



Its impulse response is 



smto c {n-n d ) 

h\ v \n\ = — , — oo < n < oo. (5.13) 

7z(n-n d ) 

In a similar manner, we could define other ideal frequency-selective filters with linear 
phase. These filters would have the desired effect of isolating a band of frequencies in the 
input signal, as well as the additional effect of delaying the output by n d . Note, however, 
that no matter how large we make n d , the ideal lowpass filter is always noncausal. 

A convenient measure of the linearity of the phase is the group delay. The basic 
concept of group delay relates to the effect of the phase on a narrowband signal. Specifi- 
cally, consider the output of a system with frequency response H{e ia) ) for a narrowband 
input of the form x[n] = s[n] cos(coon). Since it is assumed that X{e^) is nonzero only 
around co = coo, the effect of the phase of the system can be approximated around 
co = coq as the linear approximation 

<H(e iw )^-<t>Q-ton d . (5.14) 

With this approximation, it can be shown (see Problem 5.57) that the response y[n] to 
x[n] = s[n] cos(a>on) is approximately y[n] = \H(e jeoo )\s[n — n d ] cos(coon — O — ^o^d)- 
Consequently, the time delay of the envelope s[n] of the narrowband signal x[n] with 
Fourier transform centered at coq is given by the negative of the slope of the phase at 
coo. In considering the linear approximation to <H(e it0 ) around co = coq, as given in 
Eq, (5.14), we must consider the phase response as a continuous function of co. The 
phase response specified in this way will be denoted as aig[H(e ito )] and is referred to 
as the continuous phase of H(e JQJ ). 

With phase specified as a continuous function of co, the group delay of a system is 
defined as 

t(«) = grd[H(en] = --^-{arg[ //(<?"")]}. (5.15) 

aco 

The deviation of the group delay from a constant indicates the degree of nonlinearity 

of the phase. 

Example 5.1 Effects of Attenuation and Group Delay 

As an illustration of the effect of group delay, consider a filter with frequency response 
magnitude and group delay shown in Figure 5.1. In Figure 5.2, we show an input signal 
and its spectrum. In Figure 5.3 is the resulting output signal. Note that the input signal 
consists of three consecutive narrowband pulses, at frequencies a; = 0.85 7r, co = 0.25;r, 
and co = 0.5tt. 
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Figure 5.1 Frequency response magnitude and group delay for the filter in 
Example 5.1. 
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Figure 5.2 Input signal and associated Fourier transform magnitude for 
Example 5.1. 
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Output Signal y [n] 




150 200 250 300 350 400 

Sample number(n) 

Figure 5.3 Output signal for Example 5.1 . 

Since the filter has considerable attenuation at a> — 0.85tt, the pulse at that frequency 
is not clearly present in the output. Also, since the group delay at a) = 0.25^ is 
approximately 200 samples and at o> = 0.5^ is approximately 50 samples, the second 
pulse in x[n] will be delayed by about 200 samples and the third pulse by 50 samples, 
as we see is the case in Figure 5.3. 



5.2 SYSTEM FUNCTIONS FOR SYSTEMS CHARACTERIZED 
BY LINEAR CONSTANT-COEFFICIENT DIFFERENCE 
EQUATIONS 

While ideal frequency-selective filters are useful conceptually, they cannot be imple- 
mented with finite computation. Therefore, it is of interest to consider a class of systems 
that can be implemented as approximations to ideal frequency-selective filters. 

In Section 2.5, we considered the class of systems whose input and output satisfy 
a linear constant-coefficient difference equation of the form 



N 



M 



^2 a k y[n - *] = ^ bkX ^ n ~ k ^ 



(5.16) 



*=o 



*=o 



We showed that if we further assume that the system is causal, the difference equation 
can be used to compute the output recursively. If the auxiliary conditions correspond 
to initial rest, the system will be causal, linear, and time invariant. 

The properties and characteristics of LTI systems for which the input and output 
satisfy a linear constant-coefficient difference equation are best developed through the 
z-transform. Applying the z-transform to both sides of Eq. (5.16) and using the linearity 
property (Section 3.4.1) and the time-shifting property (Section 3.4.2), we obtain 



N 



M 



£>z-*Y(z) = £>*"**(*), 



Jt=0 



*=0 
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or equivalently, 

' Y, "kl~ k ) Y{z) = ( 53 b k z~ k I X(z). (5.17) 



,k=0 / \k=0 



From Eq. (5.2) and Eq. (5.17), it follows that, for a system whose input and output satisfy 
a difference equation of the form of Eq. (5.16), the system function has the algebraic 
form 



M 

,-k 



X(z) 



k=0 

N 



H(z) = ¥& = ^ ' ( 5 - 18 > 



*=0 

r -i 



H(z) in Eq. (5.18) is a ratio of polynomials in z, because Eq. (5.16) consists of a linear 
combination of delay terms. Although Eq. (5.18) can, of course, be rewritten so that 
the polynomials are expressed as powers of z rather than of z _1 , it is common practice 
not to do so. Also, it is often convenient to express Eq. (5.18) in factored form as 

M 

no - c ^ _i ) 

H(z) = (*>) *£ . (5.19) 



Ylv-dtz- 1 ) 

k=l 

Each of the factors (1 — qz _1 ) in the numerator contributes a zero at z = c* and a pole 
at z = 0. Similarly, each of the factors (1 — dkZ~ A ) in the denominator contributes a zero 
at z = and a pole at z = dk. 

There is a straightforward relationship between the difference equation and the 
corresponding algebraic expression for the system function. Specifically, the numerator 
polynomial in Eq. (5.18) has the same coefficients and algebraic structure as the right- 
hand side of Eq. (5.16) (the terms of the form bkZ~ k correspond to bkx[n — k]), while the 
denominator polynomial in Eq. (5.18) has the same coefficients and algebraic structure 
as the left-hand side of Eq. (5.16) (the terms of the format - * correspond to a^yty — k]). 
Thus, given either the system function in the form of Eq. (5.18) or the difference equation 
in the form of Eq. (5.16), it is straightforward to obtain the other. 

Example 5.2 Second-Order System 

Suppose that the system function of a linear time-invariant system is 

H ^ = j^p0j^y (5 ' 20) 

To find the difference equation that is satisfied by the input and output of this system, we 
express H(z) in the form of Eq. (5.18) by multiplying the numerator and denominator 
factors to obtain the ratio of polynomials 

l + 2z~ 1 +z~ 2 Y(z) 

H{Z)= l + \^-lz-> = W>- (5 ' 21) 
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Thus, 

(1 + \z x - \z- 2 ) Y(z) = (1 + 2z~ ] + z~ 2 )X{z), 

and the difference equation is 

y[n] + \y[n ~ 1] - \y[n - 2] = jr[/i] + 2*[n - 1] + x[n - 2]. (5.22) 

Note that once the correspondence is well understood, it is possible to proceed directly 
from Eq. (5.21) to Eq. (5.22) without the intervening algebra (and vice versa). 

5.2.1 Stability and Causality 

To obtain Eq. (5.18) from Eq. (5.16), we assumed that the system was linear and time 
invariant, so that Eq. (5.2) applied, but we made no further assumption about stability or 
causality. Correspondingly, from the difference equation, we can obtain the algebraic 
expression for the system function, but not the region of convergence. Specifically, 
the region of convergence of H(z) is not determined from the derivation leading to 
Eq. (5.18), since all that is required for Eq. (5.17) to hold is that X(z) and Y(x) have 
overlapping regions of convergence. This is consistent with the fact that, as we saw in 
Chapter 2, the difference equation does not uniquely specify the impulse response of a 
linear time-invariant system. For the system function of Eq. (5.18) or (5.19), there are a 
number of choices for the region of convergence. For a given ratio of polynomials, each 
possible choice for the region of convergence will lead to a different impulse response, 
but they will all correspond to the same difference equation. However, if we assume that 
the system is causal, it follows that h[n] must be a right-sided sequence, and therefore, 
the region of convergence of H(z) must be outside the outermost pole. Alternatively, if 
we assume that the system is stable, then, from the discussion in Section 2.4, the impulse 
response must be absolutely summable, i.e., 

oo 

J2 Hn]\ < oo. (5.23) 

n=— oo 

Since Eq. (5.23) is identical to the condition that 

oo 

J2 Hn]z~ n \ < oo (5.24) 

n=— oo 

for \z\ = 1, the condition for stability is equivalent to the condition that the ROC of 
H(z) include the unit circle. 

Example 5.3 Determining the ROC 

Consider the LTI system with input and output related through the difference equation 

y[n] - \y[n - 1] + y[n - 2] = x[n]. (5.25) 

From the previous discussions, H(z) is given by 

H(z) = ^ = t ; r ■ ( 5 - 26 ) 

K) l-lz-'+z- 2 (l-^-i) (1-2^-1) V } 
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Figure 5.4 Pole-zero plot for Example 5.3. 

The pole-zero plot for H(z) is indicated in Figure 5.4. There are three possible choices 
for the ROC. If the system is assumed to be causal, then the ROC is outside the 
outermost pole, i.e., |z| > 2. In this case the system will not be stable, since the ROC 
does not include the unit circle. If we assume that the system is stable, then the ROC 
will be \ < \z\ < 2. For the third possible choice of ROC, \z\ < \, the system will be 
neither stable nor causal. 

As Example 5.3 suggests, causality and stability are not necessarily compatible require- 
ments. In order for a linear time-invariant system whose input and output satisfy a 
difference equation of the form of Eq. (5.16) to be both causal and stable, the ROC of 
the corresponding system function must be outside the outermost pole and include the 
unit circle. Clearly, this requires that all the poles of the system function be inside the 
unit circle. 



5.2.2 Inverse Systems 

For a given linear time-invariant system with system function H(z), the corresponding 
inverse system is defined to be the system with system function //, (z) such that if it is 
cascaded with H(z), the overall effective system function is unity; i.e., 



G(z) = H(z)Hi(z) = 1 



This implies that 



fli(z) = 



1 



H(z) 



The time-domain condition equivalent to Eq. (5.27) is 

g[n] = h[n] * hi[n] = 8[ri\. 
From Eq. (5.28), the frequency response of the inverse system, if it exists, is 

1 



Hi(e>°>) = 



H(ei»Y 



(5.27) 



(5.28) 



(5.29) 



(5.30) 
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i.e., Hi(e }0> ) is the reciprocal of H(e J0} ). Equivalently, the log magnitude, phase, and 
group delay of the inverse system are negatives of the corresponding functions for 
the original system. Not all systems have an inverse. For example, the ideal lowpass 
filter does not. There is no way to recover the frequency components above the cutoff 
frequency that are set to zero by such a filter. 

Many systems do have inverses, and the class of systems with rational system 
functions provides a very useful and interesting example. Specifically, consider 

M 

X\{\-c kZ -') 

with zeros at z = Ck and poles at z = dk, in addition to possible zeros and/or poles at 

z = and z = oo. Then 

N 

Hii-dtz- 1 ) 

Hi(z)= {Z) k ^ ; (532) 

nc 1 -^" 1 ) 

k=\ 

i.e., the poles of H t (z) are the zeros of H(z) and vice versa. The question arises as to what 
region of convergence to associate with Hj(z). The answer is provided by the convolu- 
tion theorem, expressed in this case by Eq. (5.29). For Eq. (5.29) to hold, the regions of 
convergence of H(z) and Hi (z) must overlap. If H(z) is causal, its region of convergence 
is 

|z| > max \dk\. (5.33) 

k 

Thus, any appropriate region of convergence for Hi(z) that overlaps with the region 
specified by Eq. (5.33) is a valid region of convergence for //,-(z). Some simple examples 
will illustrate some of the possibilities. 

Example 5.4 Inverse System for First-Order System 

Let H(z) be 

m \ X ~ 05z ' 1 

with ROC |z| > 0.9. Then Hi(z) is 

1 - 0.9z-' 



Ht(z) = 



1 - 0.5z 



-l 



Since Hi(z) has only one pole, there are only two possibilities for its ROC, and 
the only choice for the ROC of Hj(z) that overlaps with | z\ > 0.9 is |z| > 0.5. Therefore, 
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the impulse response of the inverse system is 

hi[n] = (Q.5) n u[n] - 0.9(0.5) n ~ l u[n - 1]. 
In this case, the inverse system is both causal and stable. 

Example 5.5 Inverse for System with a Zero in the ROC 

Suppose that H(z) is 

" w = r^& lzl>0 - 9 - 

The inverse system function is 

1-0.9*- 1 -2 + 1.8*" 1 



Hi(z) = 



- 0.5 1 - 2z 



-l 



As before, there are two possible regions of convergence: \z\ < 2 and \z\ > 2. 
In this case, however, both regions overlap with \z\ > 0.9, so both are valid inverse 
systems. The corresponding impulse response for an ROC \z\ < 2 is 

hn[n] = 2(2) n u[-n - 1] - 1.8(2)"- ^[-/i] 

and, for an ROC |z| > 2, is 

h i2 [n] = -2{2) n u[n] + l.S(2) n ~ l u[n - 1]. 

We see that /i,-i[/i] is stable and noncausal, while /1/2M is unstable and causal. 

A generalization from Examples 5.4 and 5.5 is that if H(z) is a causal system with 
zeros at Cjt, /c = 1, . . . , M, then its inverse system will be causal if and only if we associate 
the region of convergence, 

\z\ > max|cjt|, 

k 

with Hi(z). If we also require that the inverse system be stable, then the region of 
convergence of Hi(z) must include the unit circle. Therefore, it must be true that 

max|Cjfc| < 1; 
it 

i.e., all the zeros of H(z) must be inside the unit circle. Thus, a linear time-invariant 
system is stable and causal and also has a stable and causal inverse if and only if both 
the poles and the zeros of H(z) are inside the unit circle. Such systems are referred to 
as minimum-phase systems and will be discussed in more detail in Section 5.6. 

5.2.3 Impulse Response for Rational System Functions 

The discussion of the partial fraction expansion technique for finding inverse 
z-transforms (Section 3.3.2) can be applied to the system function H(z) to obtain a 
general expression for the impulse response of a system that has a rational system 
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function as in Eq. (5.19). Recall that any rational function of z l with only first-order 
poles can be expressed in the form 

M-N _N_ A 

~ ' (5-34) 



«(*)= £*,*-' + £ — 

r=0 k=l 



dkZ' 



where the terms in the first summation would be obtained by long division of the denom- 
inator into the numerator and would be present only if M > N. The coefficients Ak in 
the second set of terms are obtained using Eq. (3.41). If H(z) has a multiple-order pole, 
its partial fraction expansion would have the form of Eq. (3.44). If the system is assumed 
to be causal, then the ROC is outside all of the poles in Eq. (5.34), and it follows that 



M-N 



N 



h[n] = J2 B r*[n ~ r] + £ A k d n k u[n], 



(5.35) 



r=0 



k=\ 



where the first summation is included only if M > N. 

In discussing LTI systems, it is useful to identify two classes. In the first class, at 
least one nonzero pole of H(z) is not canceled by a zero. In this case there will be at least 
one term of the form Ak(dk) n u[n], and h[n] will not be of finite length, i.e., will not be 
zero outside a finite interval. Systems of this class are therefore called infinite impulse 
response (IIR) systems. A simple IIR system is discussed in the following example. 

Example 5.6 A First-Order IIR System 

Consider a causal system whose input and output satisfy the difference equation 

y[n]-ay[n-l] = x[n]. (5.36) 

The system function is (by inspection) 

1 



H(z) = 



1 — az 



-l 



(5.37) 



z-plane 



Unit circle 




Figure 5.5 Pole-zero plot for Example 5.6. 

Figure 5.5 shows the pole-zero plot of H(z). The region of convergence is \z\ > |a|, 
and the condition for stability is \a\ < 1. The inverse z-transform of H(z) is 



h[n] — a n u[n\. 



(5.38) 
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For the second class of systems, H(z) has no poles except at z = 0; i.e., N = 
in Eqs. (5.16) and (5.18). Thus, a partial fraction expansion is not possible, and H(z) is 
simply a polynomial in z~ l of the form 

M 

H(z) = £ ***"*■ ( 539 ) 

(We assume, without loss of generality, that a = 1.) In this case, H(z) is determined to 
within a constant multiplier by its zeros. From Eq. (5.39), h[n] is seen by inspection to be 

In this case, the impulse response is finite in length; i.e., it is zero outside a finite interval. 
Consequently, these systems are called finite impulse response (FIR) systems. Note that 
for FIR systems, the difference equation of Eq. (5.16) is identical to the convolution 
sum, i.e., 

M 

y[n] = ^2b k x[n-k]. (5.41) 

Example 5.7 gives a simple example of an FIR system. 
Example 5.7 A Simple FIR System 

Consider an impulse response that is a truncation of the impulse response of Exam- 
ple 5.6: 

h \ 1 _ /*"• 0<n < M, 
1 otherwise. 

Then the system function is 

M 1 _ a M+l--M-\ 

H(z) = T a n z~ n = — Z ~ 1 — . (5.42) 

^— ' 1 — az l 

n=0 

Since the zeros of the numerator are at 

z k = ae ilnkl{M+l \ * = 0,1,...,M, (5.43) 

where a is assumed real and positive, the pole at z ~ a is canceled by a zero. The 
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pole-zero plot for the case M = 7 is shown in Figure 5.6. 

3>m z-plane 

/ Seventh- 
order 
pole\^ 



\ 



la 



<3le 



-■Q-- 



Figure 5.6 Pole-zero plot for Example 5.7. 

The difference equation satisfied by the input and output of the linear time- 
invariant system is the discrete convolution 



M 



yl"] = ^2a k x[n-k]. 



(5.44) 



*=o 



However, Eq. (5.42) suggests that the input and output also satisfy the difference 
equation 

y[n] - ay[n - 1] = x[n] - a M+l x[n - M - 1]. (5.45) 

These two equivalent difference equations result from the two equivalent forms of 
H{z) in Eq. (5.42). 



5.3 FREQUENCY RESPONSE FOR RATIONAL SYSTEM 
FUNCTIONS 



If a stable linear time-invariant system has a rational system function (i.e., if its input 
and output satisfy a difference equation of the form of Eq. (5.16), then its frequency 
response (the system function of Eq. (5.18) evaluated on the unit circle) has the form 



M 



Y. bke 



— jojk 



H(e iw ) = ^- 



(5.46) 



5Z a * e ; 



— i(ok 



k=0 



That is, H(e ]Q} ) is a ratio of polynomials in the variable e ia} . To determine the magni- 
tude, phase, and group delay associated with the frequency response of such systems, it 
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is useful to express H{e^) in terms of the poles and zeros of H(z). Such an expression 
results from substituting z = e ](a into Eq. (5.19): 



M 



[1(1 - c k e-i") 



"o 



N 



(5.47) 



rj(i - d k e~n 



From Eq. (5.47), it follows that 



k=l 



M 



H(e jw )\ = 



bo 



nn- 



c k e 



-}to\ 



k=\ 



N 



(5.48) 



\\\l-d k e 



-}b>\ 



*=1 



Sometimes it is convenient to consider the magnitude squared, rather than the magni- 
tude, of the system function. The magnitude-squared function is 

\H(e j( °)\ 2 = H(e jco )H*{e j( °), 

where * denotes complex conjugation, and for H{e i( °) as in Eq. (5.47), 



M 



2 rj(i - cm-no. - 4en 

*'-"' - (5) s : " 



(5.49) 



k=\ 



From Eq. (5.48), we see that \H(e }to )\ is the product of the magnitudes of all the zero 
factors of H(z) evaluated on the unit circle, divided by the product of the magnitudes of 
all the pole factors evaluated on the unit circle. It is common practice to transform these 
products into a corresponding sum of terms by considering 201og 10 |//(e ; ' £U )| instead of 
\H(e^)\. The logarithm of Eq. (5.48) is 



201og 10 |//(^)|=201og 10 



a Q 



M 



+ £201og 10 |l-c**-* 



k=\ 



N 



(5.50) 



-^201og 10 |l-*e- 



■)(0\ 



Jt=l 



The function 20 log 10 | H(e* w )\ is referred to as the log magnitude of H(e }( °) and is 
expressed in decibels (dB). Sometimes this quantity is called the gain in dB; i.e., 



Gain in dB = 201og 10 \H(e j( °)\, 



(5-51) 
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Note that zero dB corresponds to a value of \H(e^)\ = 1, while \H(e ia> )\ = 10 m is 
20m dB. Also, \H(e Ja> )\ = 2 m is approximately 6m dB. When \H(e Ja >)\ < 1, the quantity 
201og 10 \H(e^)\ is negative. This would be the case, for example, in the stopband of a 
frequency-selective filter. It is common practice to define 

Attenuation in dB = -20 log, n \H(e ji0 )\ 

(5.52) 
= —Gain indB. 

The attenuation is therefore a positive number when the magnitude response is less 
than unity. For example, a 60-dB attenuation at a given frequency co means that at that 
frequency \H{e^)\ = 0.001. 

Another advantage to expressing the magnitude in decibels stems from Eq. (5.4a), 
which, after taking logarithms of both sides, becomes 

201og 10 |y(0| =201og 10 |//(0| +201og 10 |A-(0|, (5.53) 

so the frequency response in dB is added to the log magnitude of the input Fourier trans- 
form to find the log magnitude of the output Fourier transform. If Eq. (5.53) replaces 
Eq. (5.4a) in Eqs. (5.4), then the effects of both magnitude and phase are additive. 
The phase response for a rational system function has the form 



<H{e jw ) = < 



h 1 M N 

+ £<[i-c**~ yw ]-x;<[i -*'"''"]■ ( 5 - 54 ) 



«0 



k=l k=l 



As in Eq. (5.50), the zero factors contribute with a plus sign and the pole factors con- 
tribute with a minus sign. 

The corresponding group delay for a rational system function is 

N d M d 

k=l ^ *=1 ^ 

where arg[ ] represents the continuous phase. An equivalent expression is 

d\H( >^1 = V ldk{2 " ne[dke ~ JC ° ] _ V l^l 2 ~ Ke[c k e-n 

^ + \d k \ 2 -2Tle{d k e-^} f^ 1 + \c k f- - 2Ke{c k e-i»}' { ' } 

In Eq. (5.54), as written, the phase of each of the terms is ambiguous; i.e., any integer 
multiple of lit can be added to each term at each value of co without changing the value 
of the complex number. The expression for the group delay, on the other hand, involves 
differentiating the continuous phase. 

When the angle of a complex number is computed, with the use of an arctangent 
subroutine on a calculator or with a computer system subroutine, the principal value is 
obtained. The principal value of the phase of H(e }0} ) is denoted as ARG[//(e 7 ' a> )], where 

-n < ARG[H(e jw )] < jr. (5.57) 
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Any other angle that gives the correct complex value of the function H(e }( °) can be 
represented in terms of the principal value as 

<H(e i<0 ) = ARG[H(e jw )] + 2jtr(a)), (5.58) 

where r((u) is a positive or negative integer that can be different at each value of co. 
Similarly, in calculating any of the individual terms in Eq. (5.54), we would typically 
obtain the principal value. 

If the principal value is used to compute the phase response as a function of co y 
then ARG[//(e /w )] may be a discontinuous function. The discontinuities introduced 
by taking the principal value will be jumps of 2n radians. This is illustrated in Fig- 
ure 5.7(a), which shows a continuous-phase function arg[H(e jw )] and its principal value 
ARG[/7(e /a) )] plotted over the range < to < n. The phase function plotted in Fig- 
ure 5.7(a) exceeds the range — n to +it. The principal value, shown in Figure 5.7(b), 



arg[H(^)] 




(a) 
ARG [//(£>)] 




2h 
1 



-1 



(b) 
r(u) 



Figure 5.7 (a) Continuous-phase 

curve for a system function evaluated on 

-2 1- the unit circle, (b) Principal value of the 

phase curve in part (a), (c) Integer 
multiples of 2n to be added to 
( c ) ARG[W(e^)] to obtain arg[tf(fl' w )]. 
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has jumps of 2n due to the integer multiples of 2n that must be subtracted in certain 
regions to bring the phase curve within the range of the principal value. Figure 5.7(c) 
shows the corresponding value of r(co) in Eq. (5.58). 

Let us consider Eq. (5.54) when the principal value is used to compute the indi- 
vidual contributions to the phase. It is not difficult to see that 



ARG[H(e>°>)] = ARG 






N 



+ ^ARG[l-c k e- i<0 ] 



k=l 



(5.59) 



- Y^ ARG[1 - d k e- jco ] + 2jrr(a>), 



k=\ 



where r(co) is an integer that can be different at each value of co. The last term, +2nr, 
is required because, in general, the principal value of a sum of angles is not equal to the 
sum of the principal values of the individual angles. This is of considerable importance 
in the theory of cepstral analysis and homomorphic systems. (See Oppenheim, Schafer, 
and Stockham, 1968 and Tribolet, 1977.) However, it presents no problem in plotting 
phase functions, since the principal value can be used to compute the phase function for 
each pole and zero, and an appropriate multiple of 2n can then be added or subtracted 
as in Eq. (5.59) to obtain the principal value of the total phase function. 

The principal value of the phase function can be computed using Eq. (5.59). 
Alternatively, we can use the relation 



ARG[H{e ito )] = arctan 






(5.60) 



where Hr^^) and Hi(e }( °) are the real and imaginary parts, respectively, of H(e ico ). 
However, in computing the group delay function of Eq. (5.15), it is the derivative of the 
continuous phase function, i.e., arg[//(e' ft ')], in which we are interested: 

grd[//(0] = -A {arg [//(0]}. (5.61) 

Except at the discontinuities of ARG[H(eJ < °)] corresponding to jumps between +7r 
and — 7T, 

~{aTg[H(en]} = ^-{ARG[H(e")]}. (5.62) 

Consequently, the group delay can be obtained from the principal value by differenti- 
ating, except at the discontinuities. Similarly, we can express the group delay in terms 
of the ambiguous phase <H(e jo> ) as 

grd[H(en] = - A [<W ( e >«)], (5.63) 

with the interpretation that impulses caused by discontinuities of size 2n in <H(e^) 
are ignored. 
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5.3.1 Frequency Response of a Single Zero or Pole 

Equations (5.50), (5.54), and (5.56) represent the magnitude in dB, the phase, and the 
group delay, respectively, as a sum of contributions from each of the poles and zeros of 
the system function. To obtain further insight into the properties of frequency responses 
of stable linear time-invariant systems with rational system functions, it is worthwhile 
to first examine the properties of a single factor of the form (1 — re je e~^), where r is 
the radius and is the angle of the pole or zero in the z-plane. This factor is typical of 
either a pole or a zero at a radius r and angle in the z-plane. 
The square of the magnitude of such a factor is 

|1 - re je e- jw | 2 = (1 - re i9 e- jw )(l - re"' V w ) = 1 + r 2 - 2r co$(co - 0). (5.64) 

Since, for any complex quantity C, 

101og 10 |C| 2 =201og 10 |C|, 

the log magnitude in dB is 

201og 10 |1 - re je e~ j(1> \ = 101og 10 [l +r 2 - Ir cos(a; - $)]. (5.65) 

The principal value phase for such a factor is 



ARG[1 - re ie e-> a ] = arctan 



r sin(&> — 0) 
1 — r cos(co — 0) 



(5.66) 



Differentiating the right-hand side of Eq. (5.66) (except at discontinuities) gives the 
group delay of the factor as 

The functions in Eqs. (5.64)-(5.67) are, of course, periodic in co with period 2n. Fig- 
ure 5.8(a) shows a plot of Eq. (5.65) as a function of co over one period (0 < a> < 2tt) 
for several values of with r = 0.9. Note that the function dips sharply in the vicinity of 
co = 0. Note also, from Eq. (5.65), that when r is fixed, the log magnitude is a function 
of (co — 0), so as changes, the dip is shifted in frequency. In general, the maximum 
value of Eq. (5.65) occurs at (co — 0) = n and is 

101og 10 (l + r 1 + 2r) = 201og 10 (l + r), 

which, for r = 0.9, is equal to 5.57 dB. Similarly, the minimum value of Eq. (5.65), 
occurring at co = 0, is 

101og 10 (l + r 2 - 2r) = 201og 10 |1 - r\, 

which is equal to —20 dB for r = 0.9. Note that the plot of the magnitude-squared 
function in Eq. (5.64) would look similar to Figure 5.8(a), except that it would have a 
much wider relative range of values. Hence, its plot would appear much sharper for the 
same value of r. 
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Figure 5.8 Frequency response for a single zero, with r = 0.9 and the three 
values of e shown, (a) Log magnitude, (b) Phase, (c) Group delay. 
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Figure 5.8(b) shows the phase function in Eq. (5.66) as a function of co for r = 0.9 
and several values of 0. Note that the phase is zero at to = and that, for fixed r, the 
function simply shifts with 0. Figure 5.8(c) shows the group delay function in Eq. (5.67) 
for the same conditions on r and 6. Note that the high positive slope of the phase around 
co = 6 corresponds to a large negative peak in the group delay function at co = 0. 

A simple geometric construction is often very useful in approximate sketching of 
frequency-response functions directly from the pole-zero plot. The procedure is based 
on the facts that the frequency response corresponds to the system function evaluated 
on the unit circle in the z-plane and that the complex value of each pole and zero factor 
can be represented by a vector in the z-plane from the pole or zero to a point on the 
unit circle. Let us first illustrate the procedure for a first-order system function of the 
form 



H(z) = (l-re^z- { )= iZ "^ 



r <1 



(5.68) 



In Section 5.3,2, we will consider higher order examples. Such a factor has a pole at 
z = and a zero at z = re* 6 , as illustrated in Figure 5.9. Also indicated in this figure 
are the vectors vi, V2, and V3 = vi — V2, representing the complex numbers e^, re ]i> ', 
and (e /a> — re 1 ®), respectively. In terms of these vectors, the magnitude of the complex 
number 

e Jo> _ re }0 



e ]a> 

is the ratio of the magnitudes of the vectors V3 and vi, i.e., 

e Jo> _ re j8 



\\-re je e- joJ \ = 



ei<° 



V3J 
vi I 



(5.69) 



z-plane 




Figure 5.9 z-plane vectors for a 
first-order system function evaluated on 
the unit circle, with r < 1. 
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or, since |vi| = 1, Eq. (5.69) is just equal to | V3 1 . The corresponding phase is 

<(1 - rePe-i") = <(e* a - re j9 ) - <(<?'*») = <(v 3 ) - <(vi) 



(5.70) 



Typically, a vector such as V3 from a zero to the unit circle is referred to as a zero vector, 
and a vector from a pole to the unit circle is called a pole vector. Thus, the contribution 
of a single zero factor (1 —re }9 z~ l ) to the magnitude function at frequency co is the length 
of the zero vector V3 from the zero to the point z = e^ on the unit circle. The vector has 
minimum length when co = 0. This accounts for the sharp dip in the magnitude function 
at co = 9 in Figure 5.8(a). Note that the pole vector vi from the pole at z = to z = e ;aJ 
always has unit length. Thus, it does not have any effect on the magnitude response. 
Equation (5.70) states that the phase function is equal to the difference between the 
angle of the zero vector from the zero at re ]d to the point z = e ;aJ and the angle of the 
pole vector from the pole at z — to the point z = e* w '. 

The pole-zero plot for the case = it is shown in Figure 5.10, and the pole and zero 
vectors are shown for two different values of co. Clearly, as co increases from zero, the 
magnitude of the vector V3 decreases until it reaches a minimum at co = n , thereby ac- 
counting for the shape of the curve corresponding to = n in Figure 5.8(a). The angle of 
vector V3 in Figure 5.10 increases more slowly than co at first, so that the phase curve starts 
out negative; then, when co is close to jt , the angle of vector V3 increases more rapidly than 
co, thereby accounting for the steep positive slope of the phase function around co = jr. 
Note that when co = jt , the angles of vectors V3 and vi are equal, so the net phase is zero. 

The dependence of the frequency-response contributions of a single factor 
(1 — re^e'i *) on the radius r is shown in Figure 5.11 for = n and several values of r. 
Note that the log magnitude function plotted in Figure 5. 1 1(a) dips more sharply as r be- 
comes closer to 1; indeed, the magnitude in dB approaches — 00 at co ~ as r approaches 
1. The phase function plotted in Figure 5.11(b) has positive slope around co = 0, which 
becomes infinite as r approaches 1. Thus, for r = 1, the phase function is discontinuous, 
with a jump of jt radians at co = 0. Away from co = 0, the slope of the phase function is 
negative. Since the group delay is the negative of the slope of the phase curve, the group 
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Figure 5.10 z-plane vectors for a 
first-order system function evaluated on 
the unit circle, with = n, r < 1 . The 
pole vector &\ and the zero vector v 3 are 
shown for two different values of co. 
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Figure 5.11 Frequency response for a single zero, with e = n, r - 1, 0.9, 0.7, 
and 0.5. (a) Log magnitude, (b) Phase, (c) Group delay for r = 0.9, 0.7, and 0.5. 
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Figure 5.12 z-plane vectors for a zero 
at z = -1 for two different frequencies 
close to it to) = 7i — s and tz + s). 



delay is negative around co = 9, and it dips sharply as r approaches 1. Figure 5.11(c) 
shows that as we move away from w = 9 , the group delay becomes positive and relatively 
flat. When r = 1, the group delay is equal to \ everywhere, except at co = 9, where it is 
undefined. 

The geometric construction for a zero on the unit circle at z = —1 is shown in 
Figure 5.12. Indicated are vectors for two different frequencies, co — (tz — e) and co — 
(tz + e), where e is small. Two observations can be made. First, the length of the vector 
V3 approaches zero as co approaches the angle of the zero vector (e — ► 0). Therefore, 
the multiplicative contribution to the frequency response is zero (— oo dB). Second, the 
vector V3 changes its angle discontinuously by tz radians as co goes from {tz — e) to (tz-\-e). 

Figures 5.8 and 5.11 were restricted tor < 1. If r > 1, the log magnitude function 
behaves similarly to the case r < 1; i.e., it dips more sharply as r — ► 1, as shown in 
Figure 5.13(a). The phase function in Figure 5.13(b) shows a discontinuity of 2tz radi- 
ans at co = 9 for all values of r > 1 . The source of this discontinuity can be seen from 
Figure 5.14, which shows vectors for co = (tz — e) and co = (tz + e). Note that the pole 
vector vi has an angle of co, which varies continuously from co — to co — 2tz. The angle 
of the zero vector v 3 is labeled 03 in the figure. If this angle is measured positively in the 
counterclockwise direction, the figure shows that 03 jumps from zero to 2tz radians as 
co goes from (tz — e) to (tz + e). This jump of 2tz radians is evident in Figure 5. 13(b). The 
discontinuity of 2tz radians can be interpreted as being due to computing the principal- 
value phase function. The angle 03 can also be seen to be positive for co = (tz — e) and 
negative for co = (tz + e). With this interpretation, the angle is continuous at co = 9. 
However, since the total angle of the factor (1 — re j6 e~ jw ) is less than —tz radians at 
co — (tz + e), the principal value would appear as in Figure 5.13(b). 
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Figure 5.13 Frequency response for a single real zero outside the unit circle, 
with e = n, r = 1/0.9, 1.25, 2. (a) Log magnitude, (b) Phase (principal value), 
(c) Group delay. 
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Figure 5.14 z-plane vectors for a 
single zero evaluated on the unit circle, 
with ^ = 7t, r > 1. 



The phase curves in Figure 5.13(b) all have negative slope. Therefore, the group 
delay function for r > 1 is positive for all co. This is also easily seen by considering 
Eq. (5.67) for r > 1. 

The preceding discussion and Figures 5.8, 5.11, and 5.13 all pertain to a single 
factor of the form (\—rei 9 e~ }a> ).li the factor represents a zero of H(z), then the curves 
of Figures 5.8, 5.11, and 5.13 will contribute to the frequency-response functions with 
positive algebraic sign. If the factor represents a pole of H(z), then all the contributions 
will enter with opposite sign. Thus, the contribution of a pole z = re^ e would be the 
negative of the curves in Figures 5.8 and 5.11. Instead of dipping toward zero (— oo dB), 
the magnitude function would peak around a) = 6. The dependence on r would be the 
same as for a zero; i.e., the closer r is to 1, the more peaked will be the contribution to 
the magnitude function. For stable and causal systems, there will, of course, be no poles 
outside the unit circle; i.e., r will always be less than 1. 



5.3.2 Examples with Multiple Poles and Zeros 

In this section, we illustrate the use of the results of Section 5.3.1 to determine the 
frequency response of systems with rational system functions. 



Example 5.8 Second-Order III? System 

Consider the second-order system 
H(z) = 



1 



1 



(5.71) 



(1 - re> 6 z- l )(l - re-i e z~ l ) 1 - 2r cosflz^ 1 + r 2 z~ 2 ' 
The difference equation satisfied by the input and output of the system is 

y[n] — 2r cos9y[n — 1] 4- r 2 y[n — 2] = x[n]. 
Using the partial fraction expansion technique, we can show that the impulse response 
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Figure 5.15 Pole-zero plot for Example 5.8. 
of a causal system with this system function is 

r n sm[9(n + l)] 

h\n\ = : u\n\. 

L J sin<9 L J 



(5.72) 



The system function in Eq. (5.71) has a pole at z = re }9 and at the conjugate 
location, z = re~ }6 , and two zeros at z = 0. The pole-zero plot is shown in Figure 5.15. 
From our discussion in Section 5.3.1, 



201og 10 \H{e>°>)\ = - 101og 10 [l + r 2 - Ir cos(o; - 9)] 
- 10 log 10 [l + r 2 - 2r cos(co + 9)], 



and 



<H(ei° } ) = - arctan 



grd[//(0] = - 



- arctan 



r sin(oj + 0) 
1 — r cos(<ij + 9) 



r sin(a> — 9) 
1 -/-cos(o> - 9) 

r 2 — r cos(&> - 9) 
l + r 2 -2r cos(co -9) 1 + r 2 - 2r cos(w + 9) 



r 2 — r cos(o> + 9) 



(5.73a) 
(5.73b) 

(5.73c) 



These functions are plotted in Figure 5.16 for r = 0.9 and 9 = tt/4. 

Figure 5.15 shows the pole and zero vectors v\, V2, and V3. The magnitude re- 
sponse is the product of the lengths of the zero vectors (which in this case are always 
unity), divided by the product of the lengths of the pole vectors. That is, 



\H(en\ = 



IV3I 



1 



|vi|-|v 2 | |vi|-|v 2 | 



(5.74) 



When co % 9, the length of the vector vi = e )(D — rei e becomes small and changes 
significantly as co varies about 9, while the length of the vector v 2 = e Ja> — re~ je 
changes only slightly as co varies around co = 9. Thus, the pole at angle 9 dominates 
the frequency response around co = 9, as is evident from Figure 5.16. By symmetry, 
the pole at angle —9 dominates the frequency response around co = —9. 
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Figure 5.16 Frequency response for a complex-conjugate pair of poles as in 
Example 5.8, with r = 0.9, jt/4. (a) Log magnitude, (b) Phase, (c) Group delay. 
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Example 5.9 Second-Order FIR System 

Consider an FIR system whose impulse response is 

h[n] = 8[n] - 2r cos05[n - 1] + r 2 8[n - 2]. 
The corresponding system function is 

H(z) = 1 - Ir cos9z~ l + r 2 z~ 2 , 



(5-75) 



(5.76) 



which is the reciprocal of the system function in Example 5.8. Therefore, the frequency- 
response plots for this FIR system are simply the negative of the plots in Figure 5.16. 
Note that the pole and zero locations are interchanged in the reciprocal. 



Example 5.10 Third-Order IIR System 

In this example, we consider a lowpass filter designed using one of the approximation 
methods to be described in Chapter 7. The system function to be considered is 



"U) = 



0.05634(1 + z~ l )(l - 1.0166Z" 1 + z~ 2 ) 
(1 -0.683z- J )(l - 1.4461Z- 1 +0.7957<r 2 ) 



(5.77) 



and the system is specified to be stable. The zeros of this system function are at the 
following locations: 



Radius 



Angle 



n rad 

±1.0376 rad (59.45°) 



The poles are at the following locations: 



Radius 



Angle 



0.683 

0.892 ±0.6257 rad (35.85°) 



The pole-zero plot for this system is shown in Figure 5.17. Figure 5.18 shows the 

$m z-plane 




Figure 5.17 Pole-zero plot for the lowpass filter of Example 5.1 0. 
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Figure 5.18 Frequency response for the lowpass filter of Example 5.10. (a) Log 
magnitude, (b) Phase, (c) Group delay. 
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log magnitude, phase, and group delay of the system. The effect of the zeros that 
are on the unit circle at co — ±1.0376 and jr is clearly evident. However, the poles 
are placed so that, rather than peaking for frequencies close to their angles, the total 
log magnitude remains close to dB over a band from co = to co = 0.2tt (and, 
by symmetry, from a> = 1.8jt to a> = 2tt), and then it drops abruptly and remains 
below -25 dB from about co = 0.3tt to I.Jtt. As suggested by this example, useful 
approximations to frequency-selective filter responses can be achieved using poles to 
build up the magnitude response and zeros to suppress it. 

In this example, we see both types of discontinuities in the plotted phase curve. 
At co % 0.22;r, there is a discontinuity of In due to the use of the principal value in 
plotting. At co = ±1.0376 and co = tt, the discontinuities of n are due to the zeros on 
the unit circle. 



5.4 RELATIONSHIP BETWEEN MAGNITUDE AND PHASE 

The frequency response of a linear time-invariant system is the Fourier transform of the 
impulse response. In general, knowledge about the magnitude provides no information 
about the phase, and vice versa. However, for systems described by linear constant- 
coefficient difference equations, i.e., rational system functions, there is some constraint 
between magnitude and phase. In particular, as we discuss in this section, if the magni- 
tude of the frequency response and the number of poles and zeros are known, then there 
are only a finite number of choices for the associated phase. Similarly, if the number of 
poles and zeros and the phase are known, then, to within a scale factor, there are only 
a finite number of choices for the magnitude. Furthermore, under a constraint referred 
to as minimum phase, the frequency-response magnitude specifies the phase uniquely, 
and the frequency-response phase specifies the magnitude to within a scale factor. 

To explore the possible choices of system function, given the square of the mag- 
nitude of the system frequency response, we consider \H{e^)\ 2 expressed as 

\H(e^)\ 2 = H(e' a )H*(e' a ) 

(5.78) 

= H(Z)H'(1/Z*)\ z =ei». 

Restricting the system function H(z) to be rational in the form of Eq. (5.19), i.e., 

M 

lit 1 - <w _1 ) 

k=l 



we see that H*(l/z*) in Eq. (5.78) is 



M 






k=l 
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where we have assumed that ao and bo are real. Therefore, Eq. (5.78) states that the 
square of the magnitude of the frequency response is the evaluation on the unit circle 
of the z-transform 

C(z) = H(z)H*(l/z*) (5.81) 

M 

na-ctf-'xi-cw 

N • (5-82) 

j[{l - tkz-'Xl - d' k z) 



^o\ k=l 



If we are given | H(e ja) )\ 2 , then by replacing e ju) by z, we can construct C(z). From C(z), 
we would like to infer as much as possible about H(z). We first note that for each pole d k 
of H(z), there is a pole of C(z) at dk and (d£ ) _1 ■ Similarly, for each zero c* of H(z), there 
is a zero of C(z) at c k and (c* k )~ l . Consequently, the poles and zeros of C(z) occur in con- 
jugate reciprocal pairs, with one element of each pair associated with H(z) and one ele- 
ment of each pair associated with H*(l/z*). Furthermore, if one element of each pair is 
inside the unit circle, then the other (i.e., the conjugate reciprocal) will be outside the unit 
circle. The only other alternative is for both to be on the unit circle in the same location. 
If H(z) is assumed to correspond to a causal, stable system, then all its poles must 
lie inside the unit circle. With this constraint, the poles of H(z) can be identified from the 
poles of C(z). However, with this constraint alone, the zeros of H(z) cannot be uniquely 
identified from the zeros of C(z). This can be seen from the following example. 

Example 5.1 1 Systems with the Same C[z) 

Consider two stable systems with system functions 

H (A - 2(1 -;-')(! + 0.5; ') 

UZ; (1 - 0.8pW 4 z- 1 )(1 - 0.8e-W4 z -i) V'™) 

and 

H( , (l-z- 1 )(l+2z- 1 ) 

2KZ) (1 -Q&>W4 Z -i)(l - 0.8e~ J"/*z- v y K V 

The pole-zero plots for these systems are shown in Figures 5.19(a) and 5.19(b), 
respectively. 

Now, 

C l (z) = H 1 (z)H*(l/z*) 

_ 2(1 - z~ l )(l +0.5<r 1 )2(l - z)(l +0.5z) ( 5 * 85 ) 

~ (1 - 0.8e>*/ 4 z- l )(l - 0.&>-J*/*z- l )(l - 0.8e-W4 z )(i _ 0.8e^/ 4 z) 

and 

C 2 (z) = H 2 {z)H*(\fz*) 

= (l-z- 1 Xl+2z- 1 )(l-z)(l+2;) ( 5 " 86 > 

~ (1 - 0.8e^/ 4 z~ l )(l - 0.8e-i*/ 4 z- l )(\ - 0.8e"W 4 z)(l - 0.8W*/ 4 z)" 
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Figure 5.19 Pole-zero plots fortwo system functions and their common magnitude- 
squared function, (a) H^(z). (b) H 2 (z). (c) C^z), C 2 {z). 



Using the fact that 



4(1 + 0.5z- l )(l + 0.5z) = (1 + 2z~ l )(l + 2z), 



(5.87) 



we see that C\{z) = Cz(z). The pole-zero plot for C\{z) and C2(z) is shown in Fig- 
ure 5.19(c). 



The system functions Hi (z) and Hi{z) in Example 5.11 differ only in the location of 
the zeros. In the example, the factor 2(1 + 0.5z -1 ) = (z _1 + 2) contributes the same to 
the square of the magnitude of the frequency response as the factor (1 + 2z _1 ), and 
consequently, j H\ {e jco ) \ and | H 2 (e j( °) | are equal. However, the phase functions for these 
two frequency responses are different. 
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Example 5.12 

Suppose we are given the pole-zero plot for C(z) in Figure 5.20 and want to determine 
the poles and zeros to associate with H{z). The conjugate reciprocal pairs of poles and 
zeros for which one element of each is associated with H(z) and one with H*(\/z*) 
are as follows: 



Pole pair 1 


(PuPa) 


Pole pair 2 


{Pi, Ps) 


Pole pair 3 


(/>3, Pe) 


Zero pair 1 


(Zi,Z 4 ) 


Zero pair 2 


(Z 2 , Z 5 ) 



Zero pair 3 



(Z 3 , Z 6 ) 



Knowing that H(z) corresponds to a stable, causal system, we must choose the poles 
from each pair that are inside the unit circle, i.e., P\, P2, and P3. No such constraint is 
imposed on the zeros. However, if we assume that the coefficients a^ and bk are real 
in Eqs. (5.16) and (5.18), the zeros (and poles) either are real or occur in complex 
conjugate pairs. Consequently, the zeros to associate with H(z) are 



and 



Z 3 or Z 6 

(Zi,Z 2 ) or (Z 4 , Z 5 ). 



Z-plane 




Figure 5.20 Pole-zero plot for the magnitude-squared function in Example 5.12. 

Therefore, there are a total of four different stable, causal systems with three poles 
and three zeros for which the pole-zero plot of C(z) is that shown in Figure 5.20 and, 
equivalently, for which the frequency-response magnitude is the same. If we had not 
assumed that the coefficients a* and bk were real, the number of choices would be 
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greater. Furthermore, if the number of poles and zeros of H(z) were not restricted, 
the number of choices for H(z) would be unlimited. To see this, assume that H(z) has 
a factor of the form 

z~ l -a* 



i.e., 

H(z) = H l {z) Z . A ~"\ . (5.88) 

1 - az l 

Factors of this form are referred to as all-pass factors, since they have unity magnitude 
on the unit circle; they are discussed in more detail in Section 5.5. It is easily verified 
that 

C(z) = H(z)H*(\/z*) = H 1 (z)H;(\/z*); (5.89) 

i.e., all-pass factors cancel in C(z) and therefore would not be identifiable from the 
pole-zero plot of C(z). Consequently, if the number of poles and zeros of H(z) is 
unspecified, then, given C(z), any choice for H(z) can be cascaded with an arbitrary 
number of all-pass factors with poles inside the unit circle (i.e., \a\ < 1). 



5.5 ALL-PASS SYSTEMS 

As indicated in the discussion of Example 5.12, a stable system function of the form 

1 — az l 

has a frequency-response magnitude that is independent of co. This can be seen by 
writing H ap (e ja) ) in the form 

e -jo> — a * 
H a Je>«>) = — 

(5.91) 

= e -]<o 

1 -ae-i°>' 

In Eq. (5.91), the term e~ ](si has unity magnitude, and the remaining numerator and 
denominator factors are complex conjugates of each other and therefore have the same 
magnitude. Consequently, \H ap {e^)\ = 1. A system for which the frequency-response 
magnitude is a constant is called an all-pass system, since the system passes all of the 
frequency components of its input with constant gain or attenuation. The most general 
form for the system function of an all-pass system with a real-valued impulse response 
is a product of factors like Eq. (5.90), with complex poles being paired with their con- 
jugates; i.e., 

m (-\ -ATI z ~ l ~ dk TT (z_1 ~ ^ )(z_1 ~ 6k) rscm 

*p« - ^n TT4FT n (i-^i-eirT (5 - 92) 

where A is a positive constant and the <4's are the real poles, and the e^s the complex 
poles, of H ap (z). For causal and stable all-pass systems, \dk\ < 1 and |e*| < 1. In terms 



Sec. 5.5 All-Pass Systems 



275 



z-plane 




Figure 5.21 Typical pole-zero plot lor 
an all-pass system. 



of our general notation for system functions, all-pass systems have M = N = 2M C + M r 
poles and zeros. Figure 5.21 shows a typical pole-zero plot for an all-pass system. In 
this case M r = 2 and M c = 1. Note that each pole of H ap (z) is paired with a conjugate 
reciprocal zero. 

The frequency response for a general all-pass system can be expressed in terms of 
the frequency responses of first-order all-pass systems like that specified in Eq. (5.90). 
For a causal all-pass system, each of these terms consists of a single pole inside the 
unit circle and a zero at the conjugate reciprocal location. The magnitude response for 
such a term is, as we have shown, unity. Thus, the log magnitude in dB is zero. With a 
expressed in polar form as a = re* 9 , the phase function for Eq. (5.90) is 



[*?-}<» — 



< 



re 



1 - rei e e-i l 



= -co — 2 arctan 



r sm((D — 6) 
1 — r cos(o> — #) 



(5.93) 



Likewise, the phase of a second-order all-pass system with poles at z = re ]Q and z = 
re~i e is 



< 



(e- 



-j°> — rp-i°\(p-l 0) — rp) e 



re 



)(«- 



re>°) 



(1 - rei e-i w )(l - re~i d e~i < °) _ 



— —2co — 2 arctan 



r sm(a) — 0) 
1 — r cos(o) — 6) 



—2 arctan 



r sin(&> + 6) 
1 — r cos((o + 6) 



(5.94) 



Example 5.13 First- and Second-Order All-Pass Systems 

Figure 5.22 shows plots of the log magnitude, phase, and group delay for two first- 
order all-pass systems, one with a real pole at z = 0.9 {0 = 0. r — 0.9) and another 
with a pole at z = ^0.9 (0 = tt, r = 0.9). For both systems, the radii of the poles are 
r = 0.9. Likewise, Figure 5.23 shows the same functions for a second-order all-pass 
system with poles at z = Q.9e^ lA and z = 0.9e _;7ry/4 . 
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Figure 5.22 Frequency response for all-pass filters with real poles at z = 0.9 
(solid line) and z = -0.9 (dashed line), (a) Log magnitude, (b) Phase (principal 
value), (c) Group delay. 



Sec. 5.5 All-Pass Systems 



277 




TT 


7T 


3tt 


2 


Radian frequency (w) 
(a) 


2 



2tt 



2 - 



a 

•-B 
a 

DC 



-2 - 



-4 



«^ 



TT 


7T 


377- 


2 


Radian frequency (ai) 
(b) 


2 



2tt 



zu 
15 


. 






C« 








1) 














e 10 


- 1 1 1 


II II 


on 




5 
n 


■A A 



Radian frequency (o») 
(c) 



3tt 
2 



2tt 



Figure 5.23 Frequency response of second-order all-pass system with poles at 
z = O.^' 7 ^ 4 . (a) Log magnitude, (b) Phase (principal value), (c) Group delay. 
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Example 5.13 illustrates a general property of causal all-pass systems. In Fig- 
ure 5.22(b), we see that the phase is nonpositive for < co < it. Similarly, in Fig- 
ure 5.23(b), if the discontinuity of In resulting from the computation of the principal 
value is removed, the resulting continuous-phase curve is nonpositive for < co < n . 
Since the more general all-pass system given by Eq. (5.92) is just a product of such first - 
and second-order factors, we can conclude that the (continuous) phase, arg[H ap (e }a) )], 
of a causal all-pass system is always nonpositive for < co < jr. This may not appear to 
be true if the principal value is plotted, as is illustrated in Figure 5.24, which shows the 
log magnitude, phase, and group delay for an all-pass system with poles and zeros as in 
Figure 5.21. However, we can establish this result by first considering the group delay. 

The group delay of the simple one-pole all-pass system of Eq. (5.90) is the negative 
derivative of the phase given by Eq. (5.93). With a small amount of algebra, it can be 
shown that 



grd 



1 - rei°e-J w 



1-r 2 \-r 



1 + r 2 - 2r cos(co -0) |1 - rei e e-i°>\ 2 



(5.95) 



Since r < 1 for a stable and causal all-pass system, from Eq. (5.95) the group delay 
contributed by a single causal all-pass factor is always positive. Since the group delay of 
a higher order all-pass system will be a sum of positive terms, as in Eq. (5.95), it is true 
in general that the group delay of a causal rational all-pass system is always positive. 
This is confirmed by Figures 5.22(c), 5.23(c), and 5.24(c), which show the group delay 
for first-order, second-order, and third-order all-pass systems, respectively. 

The positivity of the group delay of a causal all-pass system is the basis for a simple 
proof of the negativity of the phase of such a system. First, note that 

rto 

arglttpfe'*')] = - / grd[tf ap (e'*)]rftf> + arg[// ap (e' )] (5.96) 

Jo 

for < co < jr. From Eq. (5.92), it follows that 

Mr 1 A ^ c 11 „ |2 

k=\ K k=l ' K] 

Therefore, arg[H ap (e j0 )] = 0, and since 

grd[// ap (0] > 0, (5.98) 

it follows from Eq. (5.96) that 

arg[# ap (*H] < for < co < it. (5.99) 

The positivity of the group delay and the nonpositivity of the continuous phase are 
important properties of causal all-pass systems. 

All-pass systems have many uses. They can be used as compensators for phase (or 
group delay) distortion, as we will see in Chapter 7, and they are useful in the theory 
of minimum-phase systems, as we will see in Section 5.6. They are also useful in trans- 
forming frequency-selective lowpass filters into other frequency-selective forms and in 
obtaining variable-cutoff frequency-selective filters. These applications are discussed 
in Chapter 7 and applied in the problems in that chapter. 
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Figure 5.24 Frequency response for 
an all-pass system with the pole-zero 
plot in Figure 5.21. (a) Log magnitude, 
(b) Phase (principal value), (c) Group 
delay. 
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5.6 MINIMUM-PHASE SYSTEMS 

In Section 5.4, we showed that the frequency-response magnitude for an LTI system 
with rational system function does not uniquely characterize the system. If the system is 
stable and causal, the poles must be inside the unit circle, but stability and causality place 
no such restriction on the zeros. For certain classes of problems, it is useful to impose 
the additional restriction that the inverse system (one with system function 1/H(z)) 
also be stable and causal. As discussed in Section 5.2.2, this then restricts the zeros, as 
well as the poles, to be inside the unit circle, since the poles of 1/H(z) are the zeros of 
H(z). Such systems are commonly referred to as minimum-phase systems. The name 
minimum-phase comes from a property of the phase response, which is not obvious 
from the preceding definition. This and other fundamental properties that we discuss 
are unique to this class of systems, and therefore, any one of them could be taken as 
the definition of the class. These properties are developed in Section 5.6.3. 

If we are given a magnitude-squared function in the form of Eq. (5.82) and we 
know that the system is a minimum-phase system, then H(z) is uniquely determined 
and will consist of all the poles and zeros of C(z) = H(z)H*(l/z*) that lie inside the 
unit circle. 1 This approach is often followed in filter design when only the magnitude 
response is determined by the design method used. (See Chapter 7.) 

5.6.1 Minimum-Phase and All-Pass Decomposition 

In Section 5.4 we showed that, from the square of the magnitude of the frequency re- 
sponse alone, we could not uniquely determine the system function H(z), since any 
choice that had the given frequency-response magnitude could be cascaded with arbi- 
trary all-pass factors without affecting the magnitude. A related observation is that any 
rational system function 2 can be expressed as 

H(z) = H min (z)H ap (z), (5.100) 

where H mm (z) is a minimum-phase system and H ap (z) is an all-pass system. 

To show this, suppose that H(z) has one zero outside the unit circle at z = 1/c*, 
where \c\ < 1, and the remaining poles and zeros are inside the unit circle. Then H(z) 
can be expressed as 

H(z) = H x (z)(z- 1 - c + ), (5.101) 

where, by definition, H\(z) is minimum phase. An equivalent expression for H(z) is 

H(z) = //i(z)(l - cr 1 ) .' '~ C * . (5.102) 

i — cz 

Since \c\ < 1, the factor //i(z)(l — cz~ l ) also is minimum phase, and it differs from H(z) 
only in that the zero of H(z) that was outside the unit circle at z = 1/c* is reflected inside 

'We have assumed that C(z) has no poles or zeros on the unit circle. Strictly speaking, systems with 
poles on the unit circle are unstable and are generally to be avoided in practice. Zeros on the unit circle, 
however, often occur in practical filter designs. By our definition, such systems are nonminimum phase, but 
many of the properties of minimum-phase systems hold even in this case. 

2 Somewhat for convenience, we will restrict the discussion to stable, causal systems, although the 
observation applies more generally. 
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the unit circle to the conjugate reciprocal location z = c. The term (z _1 — c*)/(l — cz~ l ) 
is all-pass. This example can be generalized in a straightforward way to include more 
zeros outside the unit circle, thereby showing that, in general, any system function can 
be expressed as 

H(z) = H m Uz)H ap (z), (5.103) 

where H m in(z) contains the poles and zeros of H(z) that lie inside the unit circle, plus 
zeros that are the conjugate reciprocals of the zeros of H(z) that lie outside the unit 
circle. H ap (z) is comprised of all the zeros of H(z) that lie outside the unit circle, together 
with poles to cancel the reflected conjugate reciprocal zeros in // m j n (z). 

Using Eq. (5.103), we can form a nonminimum-phase system from a minimum- 
phase system by reflecting one or more zeros lying inside the unit circle to their conjugate 
reciprocal locations outside the unit circle, or, conversely, we can form a minimum- 
phase system from a nonminimum-phase system by reflecting all the zeros lying outside 
the unit circle to their conjugate reciprocal locations inside. In either case, both the 
minimum-phase and the nonminimum-phase systems will have the same frequency- 
response magnitude. 



Example 5.14 Minimum-Phase/All-Pass Decomposition 

To illustrate the decomposition of a stable, causal system into the cascade of a minimum- 
phase and an all-pass system, consider the two stable, causal systems specified by the 
system functions 

I + 5Z- 1 
and 

(l + 3 e +W4 z -lj( 1+ 3 e -;>/4 z -l) 



mz) = 



(1-i*- 1 ) 



The first system function, H\ (z), has a pole inside the unit circle at z = — \ , but 
a zero outside at z = —3. We will need to choose the appropriate all-pass system to 
reflect this zero inside the unit circle. From Eq. (5.101), we have c = — 5. Therefore, 
from Eqs. (5.102) and (5.103), the all-pass component will be 

z" 1 + 1 
and the minimum-phase component will be 



» + k 



1 + l z'' 
l + \z~ l 
i.e., 

l + k-'Vz- 1 ** 



Hi(z) = 3 



3' 



l + ir- 1 Ai + iz -1 
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The second system function, H2(z), has two complex zeros outside the unit circle 
and a real pole inside. We can express #2(2) in the form of Eq. (5.101) by factoring 
\e ]n ^ and |e _y7r/4 out of the numerator terms to get 

9 (z- 1 + f «-*/«)(z-' + le**) 

M ^ = 4 rr^\ • 

Factoring as in Eq. (5.102) yields 



H 2 {Z) = 



^(i + ^-^vq^ + i^v 1 ) 

4 1 - iz-i 



The first term in square brackets is a minimum-phase system, while the second 
term is an all-pass system. 



5.6.2 Frequency-Response Compensation 

In many signal-processing contexts, a signal has been distorted by an LTI system with an 
undesirable frequency response. It may then be of interest to process the distorted signal 
with a compensating system, as indicated in Figure 5.25. This situation may arise, for 
example, in transmitting signals over a communication channel. If perfect compensation 
is achieved, then s c [n] = s[n], i.e., H c (z) is the inverse of Hd(z). However, if we assume 
that the distorting system is stable and causal and require the compensating system to 
be stable and causal, then perfect compensation is possible only if Hd(z) is a minimum- 
phase system, so that it has a stable, causal inverse. 

Based on the previous discussions, assuming that H d {z) is known or approximated 
as a rational system function, we can form a minimum-phase system Hdmm{z) by reflect- 
ing all the zeros of H^z) that are outside the unit circle to their conjugate reciprocal 
locations inside the unit circle. Hd{z) and Hd m \n{z) have the same frequency-response 
magnitude and are related through an all-pass system H ap (z), i.e., 



H d (z) = H dmin (z)H ap (z) 



(5.104) 



G{z) 




Figure 5.25 Illustration of distortion 
compensation by linear filtering. 
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Choosing the compensating filter to be 



Hc(z) = 



1 



**dmm\Z) 



(5.105) 



we find that the overall system function relating s [n] and s c [n] is 



G(z) = H d {z)H c (z) = H ap (z); 



(5.106) 



i.e., G(z) corresponds to an all-pass system. Consequently, the frequency-response mag- 
nitude is exactly compensated for, while the phase response is modified to <H ap (e ja} ). 
The following example illustrates compensation of the frequency response mag- 
nitude when the system to be compensated for is a nonminimum-phase FIR system. 



Example 5.1 5 Compensation of an FIR System 

Consider the distorting system function to be 

H d (z) = (l-0.9eJ°- 6n z- l )(l -0.9e-i 06n z~ x ) 

x (1 - 125e J0 * n z- l )(l - l.25e-'°-**z- 1 ). 



(5.107) 



The pole-zero plot is shown in Figure 5.26. Since Hd(z) has only zeros (all poles are 
at z = 0), it follows that the system has a finite-duration impulse response. Therefore 
the system is stable; and since //j(z) is a polynomial with only negative powers of z, 
the system is causal. However, since two of the zeros are outside the unit circle, the 
system is nonminimum phase. Figure 5.27 shows the log magnitude, phase, and group 
delay for H d {e^). 



Unit 
circle 



z-plane 




Figure 5.26 Pole-zero plot of FIR system in Example 5.15. 
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Figure 5.27 Frequency response for FIR system with pole-zero plot in 
Figure 5.26. (a) Log magnitude, (b) Phase (principal value), (c) Group delay. 
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Figure 5.28 Frequency response for minimum-phase system in Example 5.15. 
(a) Log magnitude, (b) Phase, (c) Group delay. 
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Figure 5.29 Frequency response of all-pass system of Example 5.1 5. (The sum of 
corresponding curves in Figures 5.28 and 5.29 equals the corresponding curve in 
Figure 5.27 with the sum of the phase curves taken modulo 2tt .) (a) Log magnitude, 
(b) Phase (principal value), (c) Group delay. 
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The corresponding minimum-phase system is obtained by reflecting the zeros 
that occur at z = 1.25e ±; '°- 8jr to their conjugate reciprocal locations inside the unit 
circle. If we express Hd(z) as 



H d (z) = (l-0.9e i0 - f " I z- l )(l-0.9e->°- 6 "z- l )(1.25) 2 
x (z' 1 - 0.$e-J 0H7T )(z~ ] - 0.8^'°- 8 *), 



(5.108) 



then 



//min(z) = (1.25) 2 (1 -0.9e> il6 *z- ] )(\ -0.9e-^^ Z - 1 ) 
x (1 - 0.8e-^ a87r z- ] )(l - 0.8e>°- 8jT z-'), 
and the all-pass system that relates H mm (z) and H ( t(z) is 



(5.109) 



^ (z- l -Q.8e-i™*)(z- l -0.Hei°-**) 
«a P u; - (1 _ .8^-H^-i )( i -0.8e-i™*z- 1 )' K } 

The log magnitude, phase, and group delay of H m m{e iw ) are shown in Figure 5.28. 
Figures 5.27(a) and 5.28(a) are, of course, identical. The log magnitude, phase, and 
group delay for H ap (e^) are plotted in Figure 5.29. 

Note that the inverse system for Hd(z) would have poles at z — \.25e ± ^ )mSir and 
at z = 0.9e ±;06;r , and thus, the causal inverse would be unstable. The minimum-phase 
inverse would be the reciprocal of H m [ n (z), as given by Eq. (5.109), and if this inverse 
were used in the cascade system of Figure 5.25, the overall effective system function 
would be H ap (z), as given in Eq. (5.110). 

5.6.3 Properties of Minimum-Phase Systems 

We have been using the term "minimum phase" to refer to systems that are causal 
and stable and that have a causal and stable inverse. This choice of name is motivated 
by a property of the phase function that, while not obvious, follows from our chosen 
definition. In this section, we develop a number of interesting and important properties 
of minimum-phase systems relative to all other systems that have the same frequency- 
response magnitude. 

The Minimum Phase-Lag Property 

The use of the terminology "minimum phase" as a descriptive name for a system having 
all its poles and zeros inside the unit circle is suggested by Example 5.15. Recall that, as a 
consequence of Eq. (5.100), the continuous phase, i.e., arg[//(e ;w )], of any nonminimum- 
phase system can be expressed as 

arg[//(0] = arg[// min (eH] + arg[// ap (e> w )]. (5.111) 

Therefore, the continuous phase that would correspond to the principal-value phase 
of Figure 5.27(b) is the sum of the continuous phase associated with the minimum- 
phase function of Figure 5.28(b) and the continuous phase of the all-pass system asso- 
ciated with the principal-value phase shown in Figure 5.29(b). As was shown in Sec- 
tion 5.5, and as indicated by the principal-value phase curves of Figures 5.22(b), 5.23(b), 
5.24(b), and 5.29(b), the continuous-phase curve of an all-pass system is negative for 
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< co < 7t. Thus, the reflection of zeros of //min W from inside the unit circle to conju- 
gate reciprocal locations outside always decreases the (continuous) phase or increases 
the negative of the phase, which is called the phase-lag function. Hence, the causal, 
stable system that has \Hmi n (e iw )\ as its magnitude response and also has all its zeros 
(and, of course, poles) inside the unit circle has the minimum phase-lag function (for 
< to < n) of all the systems having that same magnitude response. Therefore, a more 
precise terminology is minimum phase-lag system, but minimum phase is historically 
the established terminology. 

To make the interpretation of minimum phase-lag systems more precise, it is 
necessary to impose the additional constraint that H(e i( °) be positive at co = 0, i.e., 

H(e i0 ) = Yl h W > °- ( 5 - 112 > 

Note that H(ei°) will be real if we restrict h[n] to be real. The condition of Eq. (5.112) is 
necessary because a system with impulse response — h[n] has the same poles and zeros 
for its system function as a system with impulse response h[ri\. However, multiplying by 
—1 would alter the phase by it radians. Thus, to remove this ambiguity, we must impose 
the condition of Eq. (5.112) to ensure that a system with all its poles and zeros inside the 
unit circle also has the minimum phase-lag property. However, this constraint is often 
of little significance, and our definition at the beginning of Section 5.6, which does not 
include it, is the generally accepted definition of the class of minimum-phase systems. 

The Minimum Group-Delay Property 

Example 5.15 illustrates another property of systems whose poles and zeros are all 
inside the unit circle. First note that the group delay for the systems that have the same 
magnitude response is 

&d[H(e'»)] = grd[// min (e^)] + grd[// ap (0]. (5.113) 

The group delay for the minimum-phase system shown in Figure 5.28(c) is always less 
than the group delay for the nonminimum-phase system shown in Figure 5.27(c). This is 
because, as Figure 5.29(c) shows, the all-pass system that converts the minimum-phase 
system into the nonminimum-phase system has a positive group delay. In Section 5.5, we 
showed this to be a general property of all-pass systems; they always have positive group 
delay for all co. Thus, if we again consider all the systems that have a given magnitude 
response |// m j n (e'" <u )|, the one that has all its poles and zeros inside the unit circle has the 
minimum group delay. An equally appropriate name for such systems would therefore 
be minimum group-delay systems, but this terminology is not generally used. 

The Minimum Energy-Delay Property 

In Example 5.15, there are a total of four causal FIR systems with real impulse responses 
that have the same frequency-response magnitude as the system in Eq. (5.107). The 
associated pole-zero plots are shown in Figure 5.30, where Figure 5.30(d) corresponds 
to Eq. (5.107) and Figure 5.30(a) to the minimum-phase system of Eq. (5.109). The 
impulse responses for these four cases are plotted in Figure 5.31. If we compare the 



Sec. 5.6 Minimum-Phase Systems 

Z-plane 



289 



Unit 
circle 




Unit 




§m 




circle 


o__ 




z-plane 


o / 


















Fourth - 


1 $le 






order 




o\ 




pole 





(a) 



(b) 



Unit 
circle 



2-plane 




(c) 



Unit 
circle 

V 


o 


3m 

Z-plane 


° \ 


o 


Fourth- J ^ 
order / 
pole / 

Figure 5.30 



the same frequency-response 
^ ' magnitude. Zeros are at all combinations 
of 0.9e ± ^°- 6jT and O.Be ± i° - 8jr and their 
reciprocals. 



four sequences in this figure, we observe that the minimum-phase sequence appears to 
have larger samples at its left-hand end than do all the other sequences. Indeed, it is 
true for this example and, in general, that 



lM0]| 5 l^min[0]| 

for any causal, stable sequence h[n] for which 

\H(en\ = |//min(^)|. 



(5.114) 



(5.115) 



A proof of this property is suggested in Problem 5.65. 

All the impulse responses whose frequency-response magnitude is equal to 
l#min(e ;w )l have the same total energy as /iminM, since, by Parseval's theorem, 



00 1 rn 1 rn 

HlM«]l 2 = 2^/ \H(en\ 2 da>=— J \H^{en\ 2 dw 

OO 



(5.116) 
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Figure 5.31 Sequences corresponding 
to the pole-zero plots of Figure 5.30. 



If we define the partial energy of the impulse response as 

n 

E[n] = Y J \h[m]\\ 

m=0 

then it can be shown that (see Problem 5.66) 

n n 



(5.117) 



(5.118) 



m=0 



m=0 
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E d [n] 



Figure 5.32 Partial energies for the four sequences of Figure 5.31. (Note that 
E a [n] is for the minimum-phase sequence h a [n] and E b [n] is for the maximum- 
phase sequence h b [n].) 

for all impulse responses h[n] belonging to the family of systems that have magni- 
tude response given by Eq. (5.115). According to Eq. (5.118), the partial energy of 
the minimum-phase system is most concentrated around n = 0; i.e., the energy of the 
minimum-phase system is delayed the least of all systems having the same magnitude 
response function. For this reason, minimum-phase (lag) systems are also called min- 
imum energy-delay systems, or simply, minimum-delay systems. This delay property is 
illustrated by Figure 5.32, which shows plots of the partial energy for the four sequences 
in Figure 5.31. We note for this example, and it is true in general, that the minimum 
energy delay occurs for the system that has all its zeros inside the unit circle (i.e., the 
minimum-phase system) and the maximum energy delay occurs for the system that has 
all its zeros outside the unit circle. Maximum energy-delay systems are also often called 
maximum-phase systems. 



5.7 LINEAR SYSTEMS WITH GENERALIZED 
LINEAR PHASE 



In designing filters and other signal-processing systems that pass some portion of the 
frequency band undistorted, it is desirable to have approximately constant frequency- 
response magnitude and zero phase in that band. For causal systems, zero phase is 
not attainable, and consequently, some phase distortion must be allowed. As we saw 
in Section 5.1.2, the effect of linear phase with integer slope is a simple time shift. A 
nonlinear phase, on the other hand, can have a major effect on the shape of a signal, 
even when the frequency-response magnitude is constant. Thus, in many situations it is 
particularly desirable to design systems to have exactly or approximately linear phase. 
In this section, we consider a formalization and generalization of the notions of linear 
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phase and ideal time delay by considering the class of systems that have constant group 
delay. We begin by reconsidering the concept of delay in a discrete-time system. 

5.7.1 Systems with Linear Phase 

Consider an LTI system whose frequency response over one period is 

H id (en = e~ ja>a , \(o\<tt, (5.119) 

where a is a real number, not necessarily an integer. Such a system is an "ideal delay" 
system, where a is the delay introduced by the system. Note that this system has constant 
magnitude response, linear phase, and constant group delay; i.e., 

\H id (en\ = 1, (5.120a) 

<H [d (e ja> ) = -coa, (5.120b) 

grd[// ld (0] = a. (5.120c) 

The inverse Fourier transform of Hi d (e^) is the impulse response 

sin7t( n-a) /^i-m 

n ld [n] = - — , — oo < n < oo. (5.121) 

7t(n — a) 



(5.122) 



The output of this system for an input x[n] is 

r 1 _ _ sinnin — a) ^ ril sin^(« — k — a) 

yW=x[n]* — = 2^ x[k] — - — . 

7t(n — a) ,*— ' Ttin — k — a) 

v K =— OQ ' 

If a = rid, where rid ,is an integer, then, as mentioned in Section 5.1.2, 

h[ d [n] = S[n — rid] (5.123) 

and 

y[n] = x[n] *5[n — rid] = x[n — rid]. (5.124) 

That is, if a = rid is an integer, the system with linear phase and unity gain in Eq. (5.119) 
simply shifts the input sequence by rid samples. If a is not an integer, the most straight- 
forward interpretation is the one developed in Example 4.9 in Chapter 4. Specifi- 
cally, a representation of the system of Eq. (5.119) is that shown in Figure 5.33, with 
h c (t) = S(t -aT) and H c (jQ) = e~^ aT , so that 

H{e jw ) = e~ jwa , M<tt. (5.125) 

In this representation, the choice of T is irrelevant and could simply be normalized 
to unity. It is important to stress again that the representation is valid whether or not 
x[n] was originally obtained by sampling a continuous-time signal. According to the 
representation in Figure 5.33, y[n] is the sequence of samples of the time-shifted, band- 
limited interpolation of the input sequence x[n]; i.e., y[n] = x c (nT — aT). The system 
of Eq. (5.119) is said to have a time shift of a samples, even if a is not an integer. If the 
group delay a is positive, the time shift is a time delay. If a is negative, the time shift is 
a time advance. 
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Figure 5.33 Interpretation of 
noninteger delay in discrete-time 
systems. 

Figure 5.34 Representation of a 
— *- linear-phase LTI system as a cascade of 
y M a magnitude filter and a time shift. 



This discussion also provides a useful interpretation of linear phase when it is as- 
sociated with a nonconstant magnitude response. For example, consider a more general 
frequency response with linear phase, i.e., 



H{e }( °) = \H(e lto )\e- Iloa J \io\ < it. (5.126) 

Equation (5.126) suggests the interpretation of Figure 5.34. The signal x[n] is filtered 
by the zero-phase frequency response \H{e ja} )\, and the filtered output is then "time 
shifted" by the (integer or noninteger) amount a. Suppose, for example, that H(e jw ) is 
the linear-phase ideal lowpass filter 



The corresponding impulse response is 

h[ P [n] = 



■ jwa 



\CO\ < CD C , 

CO r < \0)\ < It. 



sin<w c (rt — a ) 
7t(n — a) 



(5.127) 



(5.128) 



Note that Eq. (5.121) is obtained if co c = n. 

Example 5.16 Ideal Lowpass with Linear Phase 

The impulse response of the ideal lowpass filter illustrates some interesting properties 
of linear-phase systems. Figure 5.35(a) shows h\ p [n\ for a> c = OAn and a — rid — 5. 
Note that when a. is an integer, the impulse response is symmetric about n = n^; i.e., 



hi p [2n d -n] 



sina> c (2«j — n — nd) 
Ti {2nd — n — rid) 

s\na> c {rid — n) 



(5.129) 



ti {rid ~ n) 
= h\ p [n]. 
In this case we could define a zero -phase system 

H lp {en = H lp (ene j(1>nd - |/fi P (^)|, (5.130) 

where the impulse response is shifted to the left by rid samples, yielding an even 
sequence 

sin a) c n 



h\ p [ri\ = 



Tin 



= h\ p [-n]. 



(5.131) 
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Figure 5.35(b) shows h[ p [n] for co c = OAtz and a — 4.5. This is typical of the case when 
the linear phase corresponds to an integer plus one-half. As in the case of the integer 
delay, it is easily shown that if a is an integer plus one-half (or 2a is an integer), then 

h ip [2a - n] = hi p [n]. (5.132) 

In this case, the point of symmetry is a, which is not an integer. Therefore, since the 
symmetry is not about a point of the sequence, it is not possible to shift the sequence to 
obtain an even sequence that has zero phase. This is similar to the case of Example 4.10 
with M odd. 

Figure 5.35(c) represents a third case, in which there is no symmetry at all. In 
this case, co c = OAtz and a = 4.3. 

In general a linear-phase system has frequency response 

H(e Ja >) = \H(e JM )\e' io>a . (5,133) 

As illustrated in Example 5.16, if 2a is an integer (i.e., if a is an integer or an integer 
plus one-half), the corresponding impulse response has even symmetry about a; i.e., 

h[2a -n]= h[n]. (5.134) 

If 2a is not an integer, then the impulse response will not have symmetry. This is illus- 
trated in Figure 5.35(c), which shows an impulse response that is not symmetric, but 
that has linear phase, or equivalently, constant group delay. 



5.7.2 Generalized Linear Phase 

In the discussion in Section 5.7.1, we considered a class of systems whose frequency 
response is of the form of Eq. (5.126), i.e., a real-valued nonnegative function of co mul- 
tiplied by a linear phase term e~ Ja>a . For a frequency response of this form, the phase of 
H(e }0) ) is entirely associated with the linear phase factor e~^ a 7 i.e., <H(e^ M ) = —coot, 
and consequently, systems in this class are referred to as linear-phase systems. In the 
moving average of Example 4.10, the frequency response in Eq. (4.67) is a real-valued 
function of co multiplied by a linear-phase term, but the system is not, strictly speaking, 
a linear-phase system, since, at frequencies for which the factor 

1 sin[o>(M+l)/2] 



M + 1 sin(oj/2) 



is negative, this term contributes an additional phase of tt radians to the total phase. 

Many of the advantages of linear-phase systems apply to systems with frequency 
response having the form of Eq. (4.67) as well, and consequently, it is useful to generalize 
somewhat the definition and concept of linear phase. Specifically, a system is referred to 
as a generalized linear-phase system if its frequency response can be expressed in the form 

H(e ioy ) = A(e^)e~ jaco+ ^, (5.135) 

where a and /? are constants and A(e^) is a real (possibly bipolar) function of co. For 
the linear-phase system of Eq. (5.127) and the moving-average filter of Example 4.10, 
ft = 0. We see, however, that the bandlimited differentiator of Example 4.5 has the 
form of Eq. (5.135) with a = 0, /3 = tt/2, and A(e^) = co/ T. 
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A system whose frequency response has the form of Eq. (5.135) is called a gen- 
eralized linear-phase system because the phase of such a system consists of constant 
terms added to the linear function -wa; i.e. — coa + /8 is the equation of a straight line. 
However, if we ignore any discontinuities that result from the addition of constant phase 
over all or part of the band |o;| < n, then such a system can be characterized by constant 
group delay. That is, the class of systems such that 

tM = grd[//(0] = --^-{arg[//(0]} = a (5.136) 

have linear phase of the more general form 

arg[H(e j( °)] = - wa, < oo < n, (5.137) 

where fi and a are both real constants. 

Recall that we showed in Section 5.7.1 that the impulse responses of linear-phase 
systems may have symmetry about a if 2a is an integer. To see the implication of this for 
generalized linear-phase systems, it is useful to derive an equation that must be satisfied 
by h[n], a, and p for constant group-delay systems. This equation is derived by noting 
that, for such systems, the frequency response can be expressed as 

= A{e' }0} )co$(fi - coa) + jA(e^)sin(fi - wa), 
or equivalently, as 



(5.138) 



H(e^) = Y, h[n]e~ ji 



n=— oo 

oo 



(5.139) 



= Y^ h[n\cos<on — j Y^ h[n]smcon, 



where we have assumed that h[n] is real. The tangent of the phase angle of H(e^) can 
be expressed as 

oo 

— V^ h[n] sin con 

tan(« - coa) = = — — . 

> n[n\coscon 

n=— oo 

Cross multiplying and combining terms with a trigonometric identity leads to the 
equation 

oo 

^2 h[n] sin[co(n - a) + fi] = for all co. (5.140) 

n=— oo 

This equation is a necessary condition on h[n], a, and ft for the system to have constant 
group delay. It is not a sufficient condition, however, and, due to its implicit nature, it 
does not tell us how to find a linear-phase system. For example, it can be shown that 
one set of conditions that satisfies Eq. (5.140) is 

P = or n, (5.141a) 

2a = M = an integer, (5.141b) 

h[2a -n] = h[n]. (5.141c) 
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With = or 7r, Eq. (5.140) becomes 

J2 %] sinM> - a)] = 0, (5.142) 



n=— oo 



from which it can be shown that if 2a is an integer, terms in Eq. (5.142) can be paired so 
that each pair of terms is identically zero for all oo. These conditions in turn imply that 
the corresponding frequency response has the form of Eq. (5.135) with ft = or iz and 
A(e J0} ) an even (and, of course, real) function of oo. 

Alternatively, if /? = tt/2 or 3tt/2, then Eq. (5.140) becomes 

oo 

J2 h[n] cosK/i - a)] = 0, (5.143) 



and it can be shown that 



and 



ft = tt/2 or 37T/2, (5.144a) 

2<x = M = an integer, (5.144b) 

h[2a -n] = -h[n] (5.144c) 



satisfy Eq. (5.143) for all co. Equations (5.144) imply that the frequency response has 
the form of Eq. (5.135) with ft — tt/2 and A(e J0J ) an odd function of w. 

Note that Eqs. (5.141) and (5,144) give two sets of conditions that guarantee gener- 
alized linear phase or constant group delay, but as we have already seen in Figure 5.35(c), 
there are other systems that satisfy Eq. (5.135) without these symmetry conditions. 



5.7.3 Causal Generalized Linear-Phase Systems 

If the system is causal, then Eq. (5.140) becomes 

CO 

J2 h l n ] sin[<w(n - a) + fi\ = for all oo. (5.145) 

Causality and the conditions in Eqs. (5.141) and (5.144) imply that 

h[n] =0, n < and n > M; 

i.e., causal FIR systems have generalized linear phase if they have impulse response 
length (M+ 1) and satisfy either Eq. (5.141c) or (5.144c). Specifically, it can be shown 
that if 

, r , \h\M-n], 0<n<M, /c 1 .. , 

*M = {(>! otherwise, (5 - 146a) 

then 

H(e j( °) = A e (e ia, )e- J ' aM/2 t (5.146b) 
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where A e (e ico ) is a real, even, periodic function of co. Similarly, if 

%l = {o^-" ] - °J^; (5.147a) 

then it follows that 

H(e j0) ) = jA (e jco )e~^ M/2 = A (e^)e- jwM/2+ ^ /2 , (5.147b) 

where A (e^) is a real, odd, periodic function of cd. Note that in both cases the length 
of the impulse response is (M +1) samples. 

The conditions in Eqs. (5.146a) and (5.147a) are sufficient to guarantee a causal 
system with generalized linear phase, However, they are not necessary conditions. 
Clements and Pease (1989) have shown that causal infinite-duration impulse responses 
can also have Fourier transforms with generalized linear phase. The corresponding sys- 
tem functions, however, are not rational, and thus, the systems cannot be implemented 
with difference equations. 

Expressions for the frequency response of FIR linear-phase systems are useful in 
filter design and in understanding some of the properties of such systems. In deriving 
these expressions, it turns out that significantly different expressions result, depending 
on the type of symmetry and whether M is an even or odd integer. For this reason, it is 
generally useful to define four types of FIR generalized linear-phase systems. 

Type I FIR Linear-Phase Systems 

A type I system is defined as a system that has a symmetric impulse response 

h[n] = h[M - n], < n < M, (5.148) 

with M an even integer. The delay M/2 is an integer. The frequency response is 

M 

H(e j(0 ) = J2 h[n]e^^ n . (5.149) 

By applying the symmetry condition, Eq. (5.148), the sum in Eq. (5.149) can be rewritten 
in the form 

/M/2 \ 

H(e j( °) = e - icoMj2 ^2a[k]coscok , (5.150a) 

where 

a[0] = h[M/2], (5.150b) 

a[k] = 2h[(M/2) - k], Jk==l,2 M/2. (5.150c) 

Thus, from Eq. (5.150a), we see that H(e^) has the form of Eq. (5.146b), and in par- 
ticular, /3 in Eq. (5.135) is either or n. 
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Type II FIR Linear-Phase Systems 

A type II system has a symmetric impulse response as in Eq. (5.148), with M an odd 
integer. H(e^) for this case can be expressed as 



where 



f(M+l)/2 

H(e ia ) = e- jcoM/1 I Yl b W cos h ( k ~ I)] } ' 



b[k] = 2h[(M + l)/2 - k], k = 1, 2, . . . , (M + l)/2. 



(5.151a) 



(5.151b) 



Again, H(e jw ) has the form of Eq. (5.146b) with a time delay of M/2, which in this case 
is an integer plus one-half, and fi in Eq. (5.135) is either or jr. 



2>/>e /// FZK Linear-Phase Systems 

If the system has an antisymmetric impulse response 

h[n] = -/i[A/ - /i], < w < M, 
with M an even integer, then H{e^) has the form 



(5.152) 



H(e jw ) = j e - ja)M/2 



M/2 

y^c[k]sma>k 

lk=l 



(5.153a) 



where 



c[k] = 2h[(M/2) -k], k = 1, 2, ... , M/2. 



(5.153b) 



In this case, H{e^) has the form of Eq. (5.147b) with a delay of M/2, which is an integer, 
and p in Eq. (5.135) is tz/2 or 3jt/2. 

Type IV FIR Linear-Phase Systems 

If the impulse response is antisymmetric as in Eq. (5.152) and M is odd, then 



H(e j( °) = j e - ju,M/2 



(M+l)/2 



£ d[*]sin [*>(*-!)] 



*=i 



(5.154a) 



where 



<*[*] = 2/i[(M + l)/2 -it], A: = 1, 2, . . . , (M + l)/2. 



(5.154b) 



As in the case of type III systems, H{e jw ) has the form of Eq. (5.147b) with delay M/2, 
which is an integer plus one-half, and /? in Eq. (5.135) is n/l or 3^/2. 
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Figure 5.36 Examples of FIR 
linear-phase systems, (a) Type I, M 
even, h[n] ~ h[M - n]. (b) Type II, M 
odd, h[n] = h[M- n].{c) Type III, M 
even, h[n] = -h[M - n]. (d) Type IV, 
Mo66,h[n] = -h[M-n]. 



Examples of FIR Linear-Phase Systems 

Figure 5.36 shows an example of each of the four types of FIR linear-phase systems. 
The associated frequency responses are given in Examples 5.17-5.20. 



Example 5.17 Type I Linear-Phase System 

If the impulse response is 

h[n] = 



1, 
0, 



< n < 4, 
otherwise, 



(5.155) 
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Figure 5.37 Frequency response of type I system of Example 5.17. (a) Magnitude, 
(b) Phase, (c) Group delay. 
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as shown in Figure 5.36(a), the system satisfies the condition of Eq. (5.148). The fre- 
quency response is 



H(en = Yl e 



4 ■ c 
1 _ P -J*»5 
jton _ x c 



1 - e-w 
"=o (5.156) 

= ^. w2 sin(5a>/2) 

sin(co/2) 

The magnitude, phase, and group delay of the system are shown in Figure 5.37. Since 
M = 4 is even, the group delay is an integer, i.e., a — 2. 



Example 5.18 type II Linear-Phase System 

If the length of the impulse response of the previous example is extended by one sam- 
ple, we obtain the impulse response of Figure 5.36(b), which has frequency response 

W(e /. )=e -/.V2j»W (5 . 157) 

sin(co/2) 

The frequency-response functions for this system are shown in Figure 5.38. Note that 
the group delay in this case is constant with a = 5/2. 



Example 5.19 Type III Linear-Phase System 

If the impulse response is 

h[n] = S[n] - S[n - 2], (5.158) 

as in Figure 5.36(c), then 

Mei") = 1 -e-i 2a > 

(5.159) 
= j[2sm(a))]e-}°>. 

The frequency-response plots for this example are given in Figure 5.39. Note 
that the group delay in this case is constant with a = 1. 

Example 5.20 Type IV Linear-Phase System 

In this case (Figure 5.36(d)), the impulse response is 

h[n] = 8[n]-8[n-ll (5.160) 

for which the frequency response is 

H(e^) = 1 - e-i" 

(5.161) 
= j[2sm(a>/2)]e-J°>t 2 . 

The frequency response for this system is shown in Figure 5.40. Note that the group 
delay is equal to | for all w. 
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Figure 5.38 Frequency response of type II system of Example 5.18. 
(a) Magnitude, (b) Phase, (c) Group delay. 
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Figure 5.39 Frequency response of type III system of Example 5.19. (a) Magni- 
tude, (b) Phase, (c) Group delay. 
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Figure 5.40 Frequency response of type IV system of Example 5.20. 
(a) Magnitude, (b) Phase, (c) Group delay. 
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Locations of Zeros for FIR Linear-Phase Systems 

The preceding examples illustrate the properties of the impulse response and the fre- 
quency response for all four types of FIR linear-phase systems. It is also instructive to 
consider the locations of the zeros of the system function for FIR linear-phase systems. 
The system function is 

M 

H(z) = J2 h W z ~ n - ( 5 * 162 ) 

In the symmetric cases (types I and II), we can use Eq. (5.148) to express H(z) as 

Af 

H(z) = ^W-n\z- n = 5>[%V M 

n=0 k=M (5.163) 

= z~ M H{z~ x ). 
From Eq. (5.163), we conclude that if zo is a zero of H(z), then 

H( Zo ) = Zv M H(zu l )=0. (5.164) 

This implies that if Zq = re } ' 9 is a zero of H(z), then Zq 1 =r~ x e~ ]6 is also a zero of H(z). 
When h[n] is real and zo is a zero of H(z), Zq = re~i 9 will also be a zero of H(z), and 
by the preceding argument, so will (zj) _1 = r~ x e }Q . Therefore, when h[n] is real, each 
complex zero not on the unit circle will be part of a set of four conjugate reciprocal 
zeros of the form 

(1 - re{ $ z~ l )(l - re-i 9 Z - l )(l - r~ VV 1 )^ - f-V'V 1 ). 

If a zero of H(z) is on the unit circle, i.e., zo = e )e , then Zq 1 = e~ }B = zj, so zeros on 
the unit circle come in pairs of the form 

(l-e'V^l-tf-'V 1 ). 

If a zero of H(z) is real and not on the unit circle, the reciprocal will also be a zero of 
H{z), and H(z) will have factors of the form 

(l±rz- 1 )(l±r- 1 z~ 1 y 

Finally, a zero of H(z) at z = ±1 can appear by itself, since ±1 is its own reciprocal and 
its own conjugate. Thus, we may also have factors of H(z) of the form 

(liz" 1 ). 

The case of a zero at z = — 1 is particularly important. From Eq. (5.163), 

H(-1) = (-1) M H(~1). 

If M is even, we have a simple identity, but if M is odd, H(—\) = — H(— 1), so H{—\) 
must be zero. Thus, for symmetric impulse responses with M odd, the system function 
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(d) Figure 5.41 Typical plots of zeros for 
linear-phase systems, (a) Type I. 
(b) Type II. (c) Type III. (d) Type IV. 



must have a zero at z — — 1. Figures 5.41(a) and 5.41(b) show typical locations of zeros 
for type I (M even) and type II (M odd) systems, respectively. 

If the impulse response is antisymmetric (types III and IV), then, following the 
approach used to obtain Eq. (5.163), we can show that 



H(z) = -z- M H(z~'). 



(5.165) 



This equation can be used to show that the zeros of H(z) for the antisymmetric case are 
constrained in the same way as the zeros for the symmetric case. In the antisymmetric 
case, however, both z = 1 and z = — 1 are of special interest. If z = 1, Eq. (5.165) 
becomes 



H(l) = -H(l). 



(5.166) 



Thus, H(z) must have a zero at z = 1 for both Meven and Modd. If z = — 1, Eq. (5.165) 
gives 



M+l 



//(-!) = (-l)- M+1 //(-l) 



(5.167) 



In this case, if (M — 1) is odd (i.e., if M is even), H(— 1) = — //(— 1), so z = -1 must be 
a zero of H(z) if M is even. Figures 5.41(c) and 5.41(d) show typical zero locations for 
type III and IV systems, respectively. 

These constraints on the zeros are important in designing FIR linear-phase sys- 
tems, since they impose limitations on the types of frequency responses that can be 
achieved. For example, we note that, in approximating a highpass filter using a symmetric 
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impulse response, M should not be odd, since the frequency response is constrained to 
be zero at co = tt(z = — 1). 



5.7.4 Relation of FIR Linear-Phase Systems to 
Minimum-Phase Systems 

The previous discussion shows that all FIR linear-phase systems with real impulse re- 
sponse have zeros either on the unit circle or at conjugate reciprocal locations. Thus, 
it is easily shown that the system function of any FIR linear-phase system can be fac- 
tored into a minimum-phase term H m \ n (z), a maximum-phase term H max (z), and a term 
H uc (z) containing only zeros on the unit circle; i.e., 

H(z) = H min (z)H uc (z)H max (z), (5.168a) 

where 

H max (z) = tfminU" V M ' (5.168b) 

and Mi is the number of zeros of H m \ n (z). In Eq. (5.168a), H m \ n (z) has all M, of its zeros 
inside the unit circle, and H uc (z) has all M Q of its zeros on the unit circle. H max (z) has 
all Mi of its zeros outside the unit circle, and, from Eq. (5.168b), its zeros are the recip- 
rocals of the zeros of H mm (z). The order of the system function H{z) is therefore M = 

2Mi + M . 



Example 5.21 Decomposition of a Linear-Phase System 

As a simple example of the use of Eqs. (5.168), consider the minimum-phase system 
function of Eq. (5.109), for which the frequency response is plotted in Figure 5.28. The 
system obtained by applying Eq. (5.168b) to H m { n (z) in Eq. (5.109) is 

H max (z) = (0.9) 2 (1 - l.mieJ°**z- l )(l - Ulllc - '' - 6 **- 1 ) 

x (1 - 1.25e-^ a87r z- 1 )(l - l.25e J0 - Sjr z~ ] )- 
H ma x(z) has the frequency response shown in Figure 5.42. Now, if these two systems 
are cascaded, it follows from Eq. (5.168) that the overall system 

H(Z) = //mi„(z)fWz) 

has linear phase. The frequency response of the composite system would be obtained 
by adding the respective log magnitude, phase, and group-delay functions. Therefore, 

201og 10 |//(e^)| = 201og 10 |H min (^)| + 201og 10 |/W^)I 

(5.169) 

= 401og 10 |// min (^)|. 
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Figure 5.42 Frequency response of maximum-phase system having the same 
magnitude as the system in Figure 5.28. (a) Log magnitude, (b) Phase (principal 
value), (c) Group delay. 
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Figure 5.43 Frequency response of cascade of maximum-phase and minimum- 
phase systems, yielding a linear-phase system, (a) Log magnitude, (b) Phase (prin- 
cipal value), (c) Group delay. 
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Similarly, 

<H{en = <H min (en + </We' w ). (5.170) 

From Eq. (5.168b), it follows that 

<H max (e^) = -coM; - <H min (en- (5-171) 

and 

<H(e i0} ) = -<oMi, 

where M-, = 4 is the number of zeros of H mm (z). In like manner, the group-delay 
functions of H m i n {e li0 ) and H maK (e^°) combine to give 

grd[//(0] = Mi = 4. 

The frequency-response plots for the composite system are given in Figure 5.43. Note 
that the curves are sums of the corresponding functions in Figures 5.28 and 5.42. 



5.8 SUMMARY 

In this chapter, we developed and explored the representation and analysis of LTI 
systems using the Fourier and z-transforms. The importance of transform analysis for 
LTI systems stems directly from the fact that complex exponentials are eigenfunctions 
of such systems and the associated eigenvalues correspond to the system function or 
frequency response. 

A particularly important class of LTI systems is that characterized by linear 
constant-coefficient difference equations. Transform analysis is particularly useful for 
analyzing these systems, since the Fourier transform or z-transform converts a differ- 
ence equation to an algebraic equation. In particular, the system function is a ratio 
of polynomials, the coefficients of which correspond directly to the coefficients in the 
difference equation. The roots of these polynomials provide a useful system representa- 
tion in terms of the pole-zero plot. Systems characterized by difference equations may 
have an impulse response that is infinite in duration (IIR) or finite in duration (FIR). 

The frequency response of LTI systems is often characterized in terms of mag- 
nitude and phase or group delay, which is the negative of the derivative of the phase. 
Linear phase is often a desirable characteristic of a system frequency response, since it 
is a relatively mild form of phase distortion, corresponding to a time shift. The impor- 
tance of FIR systems lies in part in the fact that such systems can be easily designed 
to have exactly linear phase (or generalized linear phase), while, for a given set of fre- 
quency response magnitude specifications, IIR systems are more efficient. These and 
other trade-offs will be discussed in detail in Chapter 7. 

While, in general, for LTI systems, the frequency-response magnitude and phase 
are independent, for minimum-phase systems the magnitude uniquely specifies the 
phase and the phase uniquely specifies the magnitude to within a scale factor. 
Nonminimum-phase systems can be represented as the cascade combination of a 
minimum-phase system and an all-pass system. Relations between Fourier transform 
magnitude and phase will be discussed in considerably more detail in Chapter 11. 
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PROBLEMS 



Basic Problems with Answers 

5.1. In the system shown in Figure P5.1-1, 7/(e /w ) is an ideal lowpass filter. Determine whether 
for some choice of input x[n] and cutoff frequency o> c , the output can be the pulse 



shown in Figure P5.1-2. 



y[n] = 



1, < n < 10, 
0, otherwise, 



x[n] 



H(ei°>) 



y[n) 



H{ei°>) 



to- TT Oi 



Figure P5.1-1 



y[n] 



,, /ni-i , 

• • • • — I — 1 — ■ I — • • • 



10 



Figure P5.1-2 



5.2. Consider a stable linear time-invariant system with input x[n] and output y[n]. The input 
and output satisfy the difference equation 

y[n-l]- l -$y[n] + y[n + l]=x[n]. 

(a) Plot the poles and zeros in the z-plane. 

(b) Find the impulse response h[ri\. 

5.3. Consider a linear time-invariant discrete-time system for which the input x[n] and output 
y[n] are related by the second-order difference equation 

y[n-l] + ±y[n-2] = x[n]. 

From the following list, choose two possible impulse responses for the system: 

(a) (-!)" +1 w [„+l] 

(b) 3" +1 «[rt + l] 

(c) 3(-3) n+2 u[-n~2] 

(d) I (-!)"„[-„ -2] 
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(e) (-I)" +1 w [-«-2] 

(f) (i)" +1 w [« + l] 

(g) (-3)" +[ u[n] 
(h) n l ' 2 u[n] 

5.4. When the input to a linear time-invariant system is 

x[n] = (\) n u[n] + (2) n u[-n-ll 
the output is 

y[n] = 6(\) n u[n]-6(l) n u[n]. 

(a) Find the system function H{z) of the system. Plot the poles and zeros of H(z), and 
indicate the region of convergence. 

(b) Find the impulse response h[n] of the system for all values of n. 

(c) Write the difference equation that characterizes the system. 

(d) Is the system stable? Is it causal? 

5.5. Consider a system described by a linear constant-coefficient difference equation with initial- 
rest conditions. The step response of the system is given by 

y[n]= (J)"m[/i]+(J)"m[/i] + mM. 

(a) Determine the difference equation. 

(b) Determine the impulse response of the system. 

(c) Determine whether or not the system is stable. 

5.6. The following information is known about a linear time-invariant system: 

(a) The system is causal. 

(b) When the input is 

^W = -jG) n "W-|(2)M-«-iL 

the z-transform of the output is 

\-z 2 



Y(z) = 



(l-Iz- 1 )(l-2z- 1 ) 



(c) Find the z-transform of x[n]. 

(d) What are the possible choices for the region of convergence of Y (z)l 

(e) What are the possible choices for the impulse response of the system? 

5.7. When the input to a linear time-invariant system is 

x[n] = 5u[n], 
the output is 

y[„]= [2 (i)" + 3 (-|)>[„]. 
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(a) Find the system function H(z) of the system. Plot the poles and zeros of H(z), and 
indicate the region of convergence. 

(b) Find the impulse response of the system for all values of n. 

(c) Write the difference equation that characterizes the system. 

5.8. A causal linear time-invariant system is described by the difference equation 

y[n] = \y[n - 1] + y[n - 2] + x[n - 1]. 

(a) Find the system function H(z) = Y(z)/X(z) for this system. Plot the poles and zeros 
of H(z), and indicate the region of convergence. 

(b) Find the impulse response of the system. 

(c) You should have found the system to be unstable. Find a stable (noncausal) impulse 
response that satisfies the difference equation. 

5.9. Consider a linear time-invariant system with input x[n] and output y[n] for which 

y[n~l] -lyin] + y[n + l] = x[n]. 

The system may or may not be stable or causal. 

By considering the pole-zero pattern associated with the preceding difference equa- 
tion, determine three possible choices for the impulse response of the system. Show that 
each choice satisfies the difference equation. Indicate which choice corresponds to a stable 
system and which choice corresponds to a causal system. 

5.10. If the system function H(z) of a linear time-invariant system has a pole-zero diagram as 
shown in Figure P5.10-1 and the system is causal, can the inverse system Hj(z), where 
H{z)Hi(z) = 1, be both causal and stable? Clearly justify your answer. 



Unit 
circle 



£-plane 




Figure P5.1 0-1 



5.11. The system function of a linear time-invariant system has the pole-zero plot shown in Fig- 
ure P5.11-1 Specify whether each of the following statements is true, is false, or cannot be 
determined from the information given. 

(a) The system is stable. 

(b) The system is causal. 

(c) If the system is causal, then it must be stable. 

(d) If the system is stable, then it must have a two-sided impulse response. 
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3m 



z -plane 




Unit circle 



Figure P5.11-1 



5.12. A discrete-time causal LTI system has the system function 



"M = 



(l+0.2z- l )(l-9z- 2 ) 
(1+0.8U- 2 ) 



(a) Is the system stable? 

(b) Find expressions for a minimum-phase system H\{z) and an all-pass system // ap (z) 
such that 



//(z) = //lU)//ap(z). 

5.13. Figure P5.13-1 shows the pole-zero plots for four different LTI systems. Based on these 
plots, state whether or not each system is an all-pass system. 




3m 





$™ H A {z) 

o 




Figure P5.13-1 
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5.14. Determine the group delay for < cd < it for each of the following sequences: 
(a) 

n - 1, 1 < n < 5, 

xi[n]= {9-n, 5 <n<9, 

0, otherwise. 



(b) 



*2[«] = | ^ 



l"-i| 



+ l \ 



5.15. Consider the class of discrete-time niters whose frequency response has the form 

H(e ja, ) = \H(e iu, )\e- Jaa> , 

where | H{e^)\ is a real and nonnegative function of cd and a is a real constant. As discussed 
in Section 5.7.1, this class of filters is referred to as linear-phase niters. 

Consider also the class of discrete-time filters whose frequency response has the form 

H(e' u ) = A(e iw )e-' aa,+ i ft t 

where A (e !a} ) is a real function of co, a is a real constant, and (3 is a real constant. As discussed 
in Section 5.7.2, filters in this class are referred to as generalized linear-phase filters. 

For each of the filters in Figure P5.15-1, determine whether it is a generalized linear- 
phase filter. If it is, then find A(e^ m ), a, and ft. In addition, for each filter you determine 
to be a generalized linear-phase filter, indicate whether it also meets the more stringent 
criterion for being a linear-phase filter. 



h[n] 



t3 



?2 



t 



JL 



h[n] 



t3 



r 



h[n] 



L_ 



(a) 



(b) 



h[n] 



, r r , , , , r , 

-• — ■ — i — • — • — • — — • — ■ — » 



(d) 



(c) 



h[n] 



TT~-" 



(e) 



Figure P5.15-1 



5.16. Figure P5.16-1 plots the continuous-phase arg[//(e ;w )] for the frequency response of a 
specific LTI system, where 

arg[H(e^)] = -aco 

for \o)\ < it and a is a positive integer. 
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arg[H(e>»)] 




Figure P5.16-1 

Is the impulse response h[n] of this system a causal sequence? If the system is definitely 
causal, or if it is definitely not causal, give a proof. If the causality of the system cannot 
be determined from Figure P5.16-1, give examples of a noncausal sequence and a causal 
sequence that both have the foregoing phase response arg[H(e j(D )]. 

5.17. For each of the following system functions, state whether or not it is a minimum-phase 
system. Justify your answers: 



Hx{z) = 

H 3 (z) = 
Ha{z) = 



(l_ 2z -i)(l + I z -i) 



(1- 


k 


] ) (i + k 


■')• 


(1+ 


\r 


') (i - k 


- 1 ) 


(1- 


h- 


>)(l + |r 


- 1 )' 




i 


-b"' 




(1- 


k 


*)(l + {zr 


')' 




:-'( 


1 - 1,"') 





(1 -$*-.)(! +{*-!) 



5.18. For each of the following system functions //jt(z), specify a minimum-phase system function 
Hmin(z) such that the frequency-response magnitudes of the two systems are equal, i.e., 

\H k (ei»)\ = \H min (eni 

(a) 



-l 



Hx{z) = 



l-2z 



(b) 



*f 2 (z) = 



(c) 



n 3 (z) = 



^i(l + i*-i) 
(l-3 Z -i)(l-\z-') 



5.19. Figure P5.19-1 shows the impulse responses for several different LTI systems. Find the 
group delay associated with each system. 
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h,[n\ 



r i 1 

-• — ■ — • — • — • — ■ — •- 

-10 12 3 4 5 



.rlli 1 



-2 



J^ 



h 2 [n] 



2 3 



-1* 



h 3 [n] 



— • • ' •- 

-10 12 



-1 



r 



4 5 



-2 -1 



1 M 

-l* -lA 



h 4 [n] 



I 



-m ' • 



5 6 7 



2 3 



A 



h 5 [n] 



M«] 



-2* 



L 



5 6 



i' 1 1 1 1 1 1 1 

-1012345678 



Figure P5.19-1 



5.20. Figure P5.20-1 shows just the zero locations for several different system functions. For 
each plot, state whether the system function could be a generalized linear-phase system 
implemented by a linear constant-coefficient difference equation with real coefficients. 






Figure P5.20-1 
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Basic Problems 

5.21. Let h\ p [n] denote the impulse response of an ideal lowpass filter with unity passband gain and 
cutoff frequency a> c = n/4. Figure P5.21-1 shows five systems, each of which is equivalent 
to an ideal LTI frequency-selective filter. For each system shown, sketch the equivalent 
frequency response, indicating explicitly the band-edge frequencies in terms of o) c . In each 
case, specify whether the system is a lowpass, highpass, bandpass, bandstop, or multiband 
filter. 



x[n] 



+ V: y[n] 



' M"] 



(a) 



(-D" 



(-1)" 



x[n] ^S 



h ] P [n] 



W y[„] 



(b) 



x[n] 



h\ v [2n\ 



y[n] 



(c) 



x[n] 



x\n\ = l h ^ nl2 ^ " even 
lJ 10, «odd 



y[n] 



(d) 



x[n] 



f2 



*i P M 



(e) 



|2 



y[n] 



Figure P5.21-1 



5.22. Consider a causal linear time-invariant system with system function 



H(z) = 



1 - a~ l z 



-1,-1 



1-flz- 1 ' 
where a is real. 

(a) Write the difference equation that relates the input and the output of this system. 

(b) For what range of values of a is the system stable? 

(c) For a = \, plot the pole-zero diagram and shade the region of convergence. 
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(d) Find the impulse response h[n] for the system. 

(e) Show that the system is an all-pass system, i.e., that the magnitude of the frequency 
response is a constant. Also, specify the value of the constant. 

5.23. (a) For each of the four types of causal linear phase FIR niters discussed in Section 5.7.3, 

determine whether the associated symmetry imposes any constraint on the frequency 
response at a> = and/or co = tt, 
(b) For each of the following types of desired filter, indicate which of the four FIR filter 
types would be useful to consider in approximating the desired filter: 

Lowpass 

Bandpass 

Highpass 

Bandstop 

Differentiator 

5.24. Let x[n] be a causal, N-point sequence that is zero outside the range < n < N — 1. When 
x[n] is the input to the causal LTI system represented by the difference equation 

y[n]-\y[n-2] = x[n-2]-\x[ni 

the output is y[n] y also a causal, Af-point sequence. 

(a) Show that the causal LTI system described by this difference equation represents an 
all-pass filter. 

(b) Given that 

JV-l 



5>MI 2 = 5, 



n=0 



determine the value of 



N-\ 



X>mi : 



n=0 

5.25. Is the following statement true or false? 

Statement: It is not possible for a noncausal system to have a positive constant group 
delay; i.e., grd[i/(e' fl, )j = t > 0. 

If the statement is true, give a brief argument justifying it. If the statement is false, provide 
a counterexample. 

5.26. Consider the z-transform 

rz~ l 

H(z) = j= r : = r, \Z\>T. 

w 1 -(2r cos o) )z- 1 +r 2 z~ 2 

Assume first that &>o ¥" 0- 

(a) Draw a labeled pole-zero diagram and determine h[ri\. 

(b) Repeat Part (a) when coq = 0. This is known as a critically damped system. 
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5.27. An LTI system with impulse response hi [n] is an ideal lowpass filter with cutoff frequency 
o) c = 7r/2. The frequency response of the system is H\(e {< °). Suppose a new LTI system 
with impulse response fi2[n] is obtained from h\[n\ by 

hi[n] = {-\) n hi[nl 

Sketch the frequency response Hiie 1 ™). 



Advanced Problems 

5.28. The system function H(z) of a causal linear time-invariant system has the pole-zero con- 
figuration shown in Figure P5.28-1. It is also known that H(z) = 6 when z = 1. 



Double zero 



3m 



Z-plane 



me 



Figure P5.28-1 



(a) Determine H{z). 

(b) Determine the impulse response h[n] of the system. 

(c) Determine the response of the system to the following input signals: 
(i) x[n] = u[n]-\u[n-\] 

(ii) The sequence x[n\ obtained from sampling the continuous-time signal 

x(t) = 50+10 cos 20tt t + 30 cos 407rr 

at a sampling frequency £l s = 2?r(40) rad/s 
5.29. The system function of a linear time-invariant system is given by 



H(z) = 



21 



(l-iz- 1 )(l-2z- 1 )(l-4z- 1 ) 



It is known that the system is not stable and that the impulse response is two sided. 

(a) Determine the impulse response h[n] of the system. 

(b) The impulse response found in Part (a) can be expressed as the sum of a causal impulse 
response hi [n] and an anticausal impulse response /12M' Determine the corresponding 
system functions Hi(z) and H2(z). 

5.30. A signal x[n] is processed by a linear time-invariant system H(z) and then downsampled 
by a factor of 2 to yield y[n], as shown in Figure P5.30-1. The pole-zero plot for H(z) is 
shown in Figure P5.30-2. 
(a) Determine and sketch h[n], the impulse response of the system H(z). 
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(b) A second system is shown in Figure P5.30-3, in which the signal x[n] is first time com- 
pressed by a factor of 2 and then passed through an LTI system G(z) to obtain r[ri\. 



x[n] 



H{Z) 



w[n] 



2\ 



y[n] = w[2n] 



Figure P5.30-1 



Unit 
circle 




Afth-order pole at z = 0, 
M>2 and M is an integer 

z-plane 



Figure P5.30-2 



x[n] 



2\ 



G(z) 



Tm 



Figure P5.30-3 



Determine whether G(z) can be chosen so that y[n] = r[n] for any input x[n]. If your 
answer is no, clearly explain. If your answer is yes, specify G(z). If your answer depends 
on the value of M, clearly explain how. (M is constrained to be an integer greater than 
or equal to 2.) 

5.31. Consider a linear time-invariant system whose system function is 

H(Z) = 7 : =: . 

(l-J*-i)(l_3z-i) 

(a) Suppose the system is known to be stable. Determine the output y[n] when the input 
x[n] is the unit step sequence. 

(b) Suppose the region of convergence of H(z) includes z = oo. Determine y[n] evaluated 
at n — 2 when x[n] is as shown in Figure P5.31-1. 



2t 



n I T . T T . T T T 



^ r 



x[n] 



Figure P5.31-1 



(c) Suppose we wish to recover x[n] from y[n] by processing y[n] with an LTI system whose 
impulse response is given by hj[ri\. Determine hj[n\. Does hj[n] depend on the region 
of convergence of //(z)? 

5.32. The Fourier transform of a stable linear time-invariant system is purely real and is shown 
in Figure P5.32-1. Determine whether this system has a stable inverse system. 
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H(e*») 




Figure P5.32-1 



5.33. A sequence x[n] is the output of a linear time-invariant system whose input is s[ri\. This 
system is described by the difference equation 



x[n]=s[n]~e-* a s[n-8], 



(P5.33-1) 



where < a. 

(a) Find the system function 



Hi(z) = 



X{z) 

s(zY 



and plot its poles and zeros in the z-plane. Indicate the region of convergence. 
(b) We wish to recover s[n] from x[n] with a linear time-invariant system. Find the system 
function 



H 2 (z) = 



Y(z) 

X{z) 



such that y[n] = s[n]. Find all possible regions of convergence for Hjiz), and for each, 
tell whether or not the system is causal and/or stable. 
(c) Find all possible choices for the impulse response ti2[n] such that 



y[n] = h 2 [n] * x[n] = s[n]. 



(P5.33-2) 



(d) For all choices determined in Part (c), demonstrate, by explicitly evaluating the con- 
volution in Eq. P5.33-2, that when s[n] = S[n], y[n] = 8[n]. 
Note: As discussed in Problem 4.7, Eq. P5.33-1 represents a simple model for a multipath 
channel. The systems determined in Parts (b) and (c), then, correspond to compensation 
systems to correct for the multipath distortion. 

5.34. Consider a linear time-invariant system whose impulse response is 

hln]={±) n u[n]+( 1 s) n u[n]. 

The input x[n] is zero for n < 0, but in general, may be nonzero for < n < oo. We would 
like to compute the output y[n] for < n < 10 9 , and in particular, we want to compare the 
use of an FIR filter with that of an IIR filter for obtaining y[n] over this interval. 

(a) Determine the linear constant-coefficient difference equation for the IIR system relat- 
ing x[n] and y[n\. 

(b) Determine the impulse response h\[n] of the minimum-length LTI FIR filter whose 
output yi[n] is identical to the output y[n] for < n < 10 9 . 

(c) Specify the linear constant-coefficient difference equation associated with the FIR filter 
in Part (b). 
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(d) Compare the number of arithmetic operations (multiplications and additions) required 
toobtainy[/z]forO < n < 10 9 using the linear constant-coefficient difference equations 
in Part (a) and in Part (c). 

5.35. Consider a causal linear time-invariant system with system function H(z) and real impulse 
response. H(z) evaluated for z = e^ is shown in Figure P5.35-1. 




Figure P5.35-1 



(a) Carefully sketch a pole-zero plot for H(z) showing all information about the pole and 
zero locations that can be inferred from the figure. 

(b) What can be said about the length of the impulse response? 

(c) Specify whether <H(e^ C0 ) is linear. 

(d) Specify whether the system is stable. 

5.36. A causal linear time-invariant system has the system function 



H(z) = 



(1-1.5Z- 1 -z- z )(l+0.9z- 1 ) 
(1 - z-i)(l +0.7/z- 1 )(l -O.ljz- 1 ) 



(a) Write the difference equation that is satisfied by the input and the output of the system. 

(b) Plot the pole-zero diagram and indicate the region of convergence for the system 
function. 

(c) Sketch | H(e^)\. 

(d) State whether the following are true or false about the system: 

(i) The system is stable. 

(ii) The impulse response approaches a constant for large n. 

(iii) The magnitude of the frequency response has a peak at approximately a? = ± jt/4. 
(iv) The system has a stable and causal inverse. 

5.37. Consider a causal sequence x[n] with the z-transform 



X(z) = 



(i - W 



For what values of a is of rt jc[/i] a real, minimum-phase sequence' 
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5.38. Consider the linear time-invariant system whose system function is 

H{z) = {\-Q.9e i{iA *z' l )(l-Q.9e- i ™*z- l )(\ - 1.25c' a8ff z" l )(l - 1.25e- i0 ** z' 1 ). 

(a) Find all causal system functions that result in the same frequency-response magnitude 
as H{z) and for which the impulse responses are real valued and of the same length 
as the impulse response associated with H(z). (There are four different such system 
functions.) Identify which system function is minimum phase and which, to within a 
time shift, is maximum phase. 

(b) Find the impulse responses for the system functions in Part (a). 

(c) For each of the sequences in Part (b), compute and plot the quantity 



E[n] = Y (h[m]y 



m=0 



for < n < 5. Indicate explicitly which plot corresponds to the minimum-phase system. 

5.39. Shown in Figure P5.39-1 are eight different finite-duration sequences. Each sequence is 
four points long. The magnitude of the Fourier transform is the same for all sequences. 
Which of the sequences has all the zeros of its z-transform inside the unit circle? 
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Figure P5.39-1 



5.40. Each of the pole-zero plots in Figure P5.40-1, together with the specification of the region 
of convergence, describes a linear time-invariant system with system function H{z). In each 
case, determine whether any of the following statements are true. Justify your answer with 
a brief statement or a counterexample. 

(a) The system is a zero-phase or a generalized linear-phase system. 

(b) The system has a stable inverse Hi{z). 
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ROC:lzl<^ 

(a) 



z-plane 




ROC: \z\ > 



(b) 



z-plane 




/ z-plane 




Figure P5.40-1 



(d) 



z-plane 




5.41. Figure P5.41-1 shows two different interconnections of three systems. The impulse re- 
sponses /ii[/r], h.2[n\, and /i3[«] are as shown in Figure P5.41-2. Determine whether system 
A and/or system B is a generalized linear-phase system. 



x[n] 



M«] 



System A 



h 2 [n] 



h 3 [n] 



y[n] 



System B 




Figure P5.41-1 
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hi[n] 



h 2 [n] 



h,[n] 
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Figure P5.41 -2 

5.42. The overall system of Figure P5.42-1 is a discrete-time linear time-invariant system with 
frequency response H(e^) and impulse response h[ri\. 
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Figure P5.42-1 



(a) H(e^) can be expressed in the form 

H{e jm ) = Aie^e^^, 

with A(e }w ) real. Determine and sketch A(ei w ) and 0(a>) for \a>\ < n. 

(b) Sketch h[n] for the following: 

(i) a = 3 
(ii) of = 3j 

(iii) a = 3>\ 

(c) Consider a discrete-time linear time-invariant system for which 

H(e }w ) = A{e ja} )e jaw , \co\ < n, 

with A(e^) real. What can be said about the symmetry of h[n] for the following? 

(i) a = integer 

(ii) of = A//2, where M is an odd integer 
(iii) General a 

5.43. Consider the class of FIR filters that have h[n] real, h[n] = for n < and n > M, and one 
of the following symmetry properties: 

Symmetric: h[n] = h[M — n] 
Antisymmetric: h[n] = — h[M - n] 

All filters in this class have generalized linear phase, i.e., have frequency response of the form 

H(en = A(e }w )e-> aco+ >e, 
where A(e }ai ) is a real function of a>, a is a real constant, and £ is a real constant. 
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For the following table, show that A(e^) has the indicated form, and find the values of 
a and (5. 

Type Symmetry Filter length (M + 1) Form of A(e i<0 ) a p 

M/2 

I Symmetric Odd N a[n] cos con 

(Af+l)/2 

II Symmetric Even > b[n] cos (o(n — 1/2) 



III Antisymmetric Odd ^ c[/i]sii 

71=1 

(Af+l)/2 

IV Antisymmetric Even > d[n] sin co(n — 1/2) 



M/2 

[ ] sin con 

71=1 

(Af+l)/2 



n=l 



Here are several helpful suggestions. 

• For type I filters, first show that H(e ,w ) can be written in the form 

(Af-2)/2 (M-2)/2 

H(e J( °) = ^ h[n]e~ il ° n + J2 h ^ M " n ] e ~ MM ~ n] + h[M/2]e~^ M/2) . 

• The analysis for type III filters is very similar to that for type I, with the exception of 
a sign change and removal of one of the preceding terms. 

• For type II filters, first write H(e^ w ) in the form 

(Af-l)/2 (A/-1J/2 

n=0 n=0 

and then pull out a common factor of e~^ M ^ from both sums. 

• The analysis for type IV filters is very similar to that for type II filters. 

5.44. Let h\ p [n] denote the impulse response of an FIR generalized linear-phase lowpass fil- 
ter. The impulse response /ihpM of an FIR generalized linear-phase highpass filter can be 
obtained by the transformation 

AhpW - (-l)^ipW- 

If we decide to design a highpass filter using this transformation and we wish the resulting 
highpass filter to be symmetric, which of the four types of generalized linear-phase FIR 
filters can we use for the design of the lowpass filter? Your answer should consider all the 
possible types. 

5.45. A causal linear time-invariant discrete-time system has system function 

(l-0.5z- 1 )(l + 4z- 2 ) 



H(z) = 



(1 - 0.64z" 2 ) 



(a) Find expressions for a minimum-phase system H\{z) and an all-pass system H ap (z) 
such that 

H(z) = H^H^iz). 
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(b) Find expressions for a different minimum-phase system Hji^z) and a generalized linear- 
phase FIR system //iin(^) such that 

H{z) = H 2 (z)H lin (z). 

5.46. (a) A minimum-phase system has system function H m i n (z) is such that 

H mm (z)Ha P (z) = Hn n (z), 

where H ap (z) is an all-pass system function and H\i n (z) is a causal generalized linear- 
phase system. What does this information tell you about the poles and zeros of H m m(z)? 
(b) A generalized linear-phase FIR system has an impulse response with real values and 
h[n] = f or n < and for n > 8, and h[n] — -h[l — n]. The system function of this 
system has a zero at z = 0.8e y7r/4 and another zero at z = -2. What is H{z)l 

5.47. Consider an LTI system with input x[ti\ and output y[ri\. When the input to the system is 



r , sin(0.47rrt) 
x[n] = 5 — + 10cos(0.57Trt), 



Tin 



the corresponding output is 



y[n] = 10 



sin[0.37r(« - 10)] 



jz(n - 10) 

Determine the frequency response H(e jw ) and the impulse response h[n] for the LTI system. 

5.48. Figure P5.48-1 shows the pole-zero plots for three different causal LTI systems with real 
impulse responses. Indicate which of the following properties apply to each of the sys- 
tems pictured: stable, IIR, FIR, minimum phase, all-pass, generalized linear phase, positive 
group delay at all co. 




Figure P5.48-1 



5.49. Let S\ be an LTI system with system function: 

1-z- 5 

//i(z) = — ^ 

1 - z i 

and impulse response h\[n\. 

(a) Is S\ causal? Explain. 



\z\ > 0, 
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(b) Let g[n] = h\[n\ * fi2[n\. Specify an h 2 [n] such that g[n] has at least nine nonzero 
samples and g[n] can be considered the impulse response of a causal LTI system with 
strictly linear phase; i.e., G(e ia) ) = \G(e }0) )\e~ }<on<) for some integer no. 

(c) Let q[n] = h\[n\ * h^ln]. Specify an h^[n] such that 

q[n] = B[n] forO<* < 19. 

5.50. The LTI systems H\(e^) and H 2 (e^ w ) are generalized linear-phase systems. Which, if any, 
of the following systems also must be generalized linear-phase systems? 

(a) 

G 1 (0 = // 1 (0 + // 2 (0 

(b) 

G 2 (0 = Hi(e^)H 2 (e^) 

(c) 



G 3 (en = -L [* H^ e )H 2 {e^-^ 



)de 



5.51. This problem concerns a discrete-time filter with a real- valued impulse response h[n\. De- 
termine whether the following statement is true or false: 

Statement: If the group delay of the filter is a constant for < a> < jt, then the 
impulse response must have the property that either 

h[n] =h[M-n] 
or 

h[n] = -h[M-n], 

where M is an integer. 

If you believe that the statement is true, clearly show your reasoning. If you believe that it 
is false, provide a counterexample. 

5.52. The system function Hjj(z) represents a type II FIR generalized linear-phase system with 
impulse response hjj [n]. This system is cascaded with an LTI system whose system function 
is (1 - z~ l ) to produce a third system with system function H(z) and impulse response h[ri\. 
Prove that the overall system is a generalized linear-phase system, and determine what type 
of linear phase system it is. 

5.53. In this problem, you will consider three different LTI systems. All three are causal and 
have real impulse responses. You will be given additional information about each system. 
Using this information, state as much as possible about the poles and zeros of each system 
function and about the length of the impulse response of the system. 

(a) H\(z) has a pole at z = 0.9e ;;r/3 , and when x[n] — u[n], lim y[n] = 0. 

n— >oo 

(b) H 2 (z) has a zero at z = 0.8e' v/4 , H 2 (e jco ) has linear phase with <H 2 (e j(0 ) = -2.5w, 
and 201og 10 \H 2 {e^)\ = -00. 

(c) H 3 (z) has a pole at z = 0.8e^ 4 and |// 3 (e^)| = 1 for all co. 

5.54. The following three things are known about a signal x[n] with ^-transform X(z): 

(i) x[n] is real valued and minimum phase, 

(ii) x[n] is zero outside the interval < n < 4, 
(iii) X(z) has a zero at z = \e^ ! * and a zero at z = ^e )3n/4 . 
Based on this information, answer the following questions: 

(a) Is X(z) rational? Justify your answer. 

(b) Sketch the complete pole-zero plot for X(z) and specify its ROC. 

(c) If y[n] *x[n] = S[n] and y[n] is rightsided, sketch the pole-zero plot for Y(z) and specify 
its ROC. 
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5.55. Consider a real sequence x[n] and its DTFT X(e^ {a ). Given the following information, 
determine and plot the sequence x[n]\ 

1. x[n] is a finite-length sequence. 

2. At z = 0, X(z) has exactly five poles and no zeros. X(z) may have poles or zeros at 
other locations. 

3. The unwrapped phase function is 



1 J [— OHO — j, — 7T < £l> < 0, 



for some real constant a. 
4. The group delay of the sequence evaluated at o> = | is 2; i.e., 



5. 



6. If y[n] = x[n] * u[n], then 



H*(*H]_ /2 =2. 
-?- / \X(en\ 2 d» = 28- 

271 J-n 



— j Y(enda> = 4, 



i. r 

l r 



7. X(ei«>)L= n = 0. 

8. The sequence v[n] whose DTFT is V(e^) = Ke{X(e>°>)} satisfies v[5] = -\ . 

5.56. Let S\ be a causal and stable LTI system with impulse response h\ [n] and frequency response 
H\(ei w ). The input x[n] and output y[n] for Si are related by the difference equation 

y[n] - y[n - 1] + \y[n - 2] = x[n\. 

(a) If an LTI system S2 has a frequency response given by H2 (e ja) ) = H\{—e i( °), would you 
characterize Sj as being a lowpass filter, a bandpass filter, or a highpass filter? Justify 
your answer. 

(b) Let S3 be a causal LTI system whose frequency response H^(e Jto ) has the property that 

Is S3 a minimum-phase filter? Could S3 be classified as one of the four types of FIR 
filters with generalized linear phase? Justify your answers. 

(c) Let S4 be a stable and noncausal LTI system whose frequency response is H^e*™) and 
whose input x[n] and output y[n] are related by the difference equation: 

y[n] + a\y[n-l] + a 2 y[n-2] = pox[n], 

where ct\, ct2, and ^0 are all real and nonzero constants. Specify a value for ct\ , a value 
for c* 2 , and a value for £0 such that \H 4 (e^)\ = \Hi(e^)\. 

(d) Let S5 be an FIR filter whose impulse response is h^ln] and whose frequency response, 
H 5 (e^), has the property that H 5 (e^) - \A(e^)\ 2 for some DTFT A(e> M ) (i.e., S 5 
is a zero-phase filter). Find hs[n] such that hs[n] * h\[ri\ is the impulse response of a 
noncausal FIR filter. 
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Extension Problems 

5.57. In the system shown in Figure P5.57-1, assume that the input can be expressed in the form 

x[n] = s[n] cos(coon). 

Assume also that s[n] is lowpass and relatively narrowband; i.e., S(e jcv ) = for |o>| > A, 
with A very small and A <§C a>o, so that X(e j(V ) is narrowband around co = ±coq. 



x[n] 



H{ei") 



yW Figure P5.57-1 



(a) If \H(e! < °)\ = 1 and <H(e^) is as illustrated in Figure P5.57-2, show that y[n] = 
s[n]cos(a)on — <})q). 







<H{e >0) ) 

<t>Q 


I 




1 




-7T 


-00 




IT 


It) 











Figure P5.57-2 

(b) If \H{ei°>)\ = 1 and <H(e jto ) is as illustrated in Figure P5.57-3, show that y[n] can be 
expressed in the form 

y[n] = s[n - n d ] cos(coon - 4>q - ft>o«</). 

Show also that y[n] can be equivalently expressed as 

y[n] = s[n - rid] cos(co n - <pi), 

where —<pi is the phase of H(e^) at co = coo- 




-Si^Slope = -n d 

Figure P5.57-3 

(c) The group delay associated with H{e^) is defined as 

vH = -£arg[//(0], 

and the phase delay is defined as r p h(&>) = -{l/co)<H{e i<0 ). Assume that \H(e Ja> )\ is 
unity over the bandwidth of x[n]. Based on your results in Parts (a) and (b) and on the 
assumption that x[n] is narrowband, show that if r gr (o)o) and r p h(o>o) are both integers, 
then 

y[n] = s[n - r gr (^ )] cos{co [n - r ph (^o)]}- 
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This equation shows that, for a narrowband signal x[n], <H(e^ w ) effectively applies a 
delay of Tgr(^o) to the envelope s [n] of x[n] and a delay of r p h(&>o) to the carrier cos coon. 
(d) Referring to the discussion in Section 4.5 associated with noninteger delays of a se- 
quence, how would you interpret the effect of group delay and phase delay if T gT (coo) 
or Tph(oJo) (or both) is not an integer? 

5.58. The signal y[n] is the output of a linear time-invariant system with input x[«], which is 
zero-mean white noise. The system is described by the difference equation 

N M 

y[n] = ^2 aky [ n ~ Q + X] bkX ^ n ~ k ^ b o = l. 

Jt=l k=0 

(a) What is the z- transform <$yy(z) of the autocorrelation function yy [/t]? 

Sometimes il is of interest to process y[n] with a linear filter such that the power 
spectrum of the linear filter's output will be flat when the input to the linear filter is y[n]. 
This procedure is known as "whitening" y[n], and the linear filter that accomplishes the 
task is said to be the "whitening filter" for the signal y[ri\. Suppose that we know the 
autocorrelation function <t> yy [n\ and its z-transform <t> yy (z), but not the a^s and the bk's. 

(b) Discuss a procedure for finding a system function H w (z) of the whitening filter. 

(c) Is the whitening filter unique? 

5.59. In many practical situations, we are faced with the problem of recovering a signal that has 
been "blurred" by a convolution process. We can model this blurring process as a linear 
filtering operation, as depicted in Figure P5.59-1, where the blurring impulse response is as 
shown in Figure P5.59-2. This problem will consider ways to recover x[n] from y[n]. 



x[n] 



*- M"l 



y[n] 



Desired signal Blurred signal Figure P5.59-1 



0, otherwise 



M-l 



Figure P5.59-2 



(a) One approach to recovering x[n] from y[n] is to use an inverse filter; i.e., y[n] is filtered 
by a system whose frequency response is 

where H{e ia} ) is the Fourier transform of h[n\ For the impulse response h[n] shown 
in Figure P5.59-2, discuss the practical problems involved in implementing the inverse 
filtering approach. Be complete, but also be brief and to the point. 

(b) Because of the difficulties involved in inverse filtering, the following approach is sug- 
gested for recovering x[ri\ from y[n]: The blurred signal y[n] is processed by the system 
shown in Figure P5.59-3, which produces an output w[n] from which we can extract 
an improved replica of x[n]. The impulse responses h\[n] and /i2[«] are shown in Fig- 
ure P5.59-4. Explain in detail the working of this system. In particular, state precisely 
the conditions under which we can recover x[n] exactly from w[ri\. Hint: Consider the 
impulse response of the overall system from x[n] to w[ri\. 
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y[n] 



M«] 



h 2 [n] 



W M Figure P5.59-3 



it 



k = 



M 



2M 



3M (q-l)M qM n 



h 2 [n] = 6[n]-6[n-l] 



-1* 

Figure P5.59-4 

(c) Let us now attempt to generalize this approach to arbitrary finite-length blurring im- 
pulse responses h[n]; i.e., assume only that h[n] = Oforw < Oorn > M. Further, assume 
that hi[n] is the same as in Figure P5.59-4. How must //2(z) and H{z) be related for 
the system to work as in Part (b)? What condition must H(z) satisfy in order that it be 
possible to implement Hiiz) as a causal system? 

5.60. In this problem, we demonstrate that, for a rational z- transform, a factor of the form (z — zo) 
and a factor of the form z/(z — Zq) contribute the same phase. 

(a) Let H(z) = z - \/a, where a is real and < a < 1. Sketch the poles and zeros of the 
system, including an indication of those at z = oo. Determine <H(e^ u) ), the phase of 
the system. 

(b) Let G{z) be specified such that it has poles at the conjugate-reciprocal locations of ze- 
ros of H{z) and zeros at the conjugate-reciprocal locations of poles of H(z), including 
those at zero and oo. Sketch the pole-zero diagram of G(z). Determine <G(e ;cu ), the 
phase of the system, and show that it is identical to <//(e ;a) ). 

5.61. Prove the validity of the following two statements: 

(a) The convolution of two minimum-phase sequences is also a minimum-phase sequence. 

(b) The sum of two minimum-phase sequences is not necessarily a minimum-phase se- 
quence. Specifically, give an example of both a minimum-phase and a nonminimum- 
phase sequence that can be formed as the sum of two minimum-phase sequences. 

5.62. A sequence is defined by the relationship 

oo 

r[n] = V^ h[m]h[n + m] = h[n] * h[-n], 

m——oo 

where h[n] is a minimum-phase sequence and 

r[n\ = \{\) n u[n\ + \2 n u[-n-l\ 



(a) Find R(z) and sketch the pole-zero diagram. 
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(b) Determine the minimum-phase sequence h[n] to within a scale factor of ±1. Also, 
determine the z-transform H(z) of h[n\. 

5.63. A maximum-phase sequence is a stable sequence whose z-transform has all its poles and 
zeros outside the unit circle. 

(a) Show that maximum-phase sequences are anticausal, i.e., that they are zero for n > 0. 

FIR maximum-phase sequences can be made causal by including a finite amount 
of delay. A finite-duration causal maximum-phase sequence having a Fourier transform 
of a given magnitude can be obtained by reflecting all the zeros of the z-transform of a 
minimum-phase sequence to conjugate-reciprocal positions outside the unit circle. That is, 
we can express the z-transform of a maximum-phase causal finite-duration sequence as 

H m3LX {z) = H min (z)H ap (z), 

Obviously, this process ensures that | H m3LX (e^ w ) \ = \H mm (eJ w )\. Now, the z-transform of a 
finite-duration minimum-phase sequence can be expressed as 

M 

H min (z) = h min [0] J](l - c k z~ l ), \c k \ < 1. 

(b) Obtain an expression for the all-pass system function required to reflect all the zeros 
of H m \ n (z) to positions outside the unit circle. 

(c) Show that H max (z) can be expressed as 

H max (z) = z~ H mm (z~ ). 

(d) Using the result of Part (c), express the maximum-phase sequence /i ma x[n] in terms of 
h min [n]. 

5.64. It is not possible to obtain a causal and stable inverse system (a perfect compensator) for 
a nonminimum-phase system. In this problem, we study an approach to compensating for 
only the magnitude of the frequency response of a nonminimum-phase system. 

Suppose that a stable nonminimum-phase linear time-invariant discrete-time system 
with a rational system function H(z) is cascaded with a compensating system H c {z) as 
shown in Figure P5.64-1. 

G(en _ 

I I 

I 
I 



x[n] I 
I 



I—*- 



H(z) 



w[n] 



H c (z) 



I y[n] 



i i Figure P5. 64-1 

(a) How should H c (z) be chosen so that it is stable and causal and so that the magnitude 
of the overall effective frequency response is unity? (Recall that H(z) can always be 
represented as H(z) = H ap (z)H m i n (z).) 

(b) What are the corresponding system functions H c (z) and G(z)? 

(c) Assume that 

H(z) = (1 - 0.8e> 0371 z _1 )(l - OXe-i^z-^il - 12e j0Jn z~ l )(l - 1.2e-> - 7 * z~ l ). 

Find H m i n (z), H ap (z), H c (z), and G(z) for this case, and construct the pole-zero plots 
for each system function. 

5.65. Let /i m inM denote a minimum-phase sequence with z-transform H m \ n (z). If h[n] is a causal 
nonminimum-phase sequence whose Fourier transform magnitude is equal to \H min (e }co )\, 
show that 

l*[0]| < IW0]|. 
(Use the initial-value theorem together with Eq. (5.103).) 
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5.66. One of the interesting and important properties of minimum-phase sequences is the minimum- 
energy delay property; i.e., of all the causal sequences having the same Fourier transform 
magnitude function \H(e* (0 )\, the quantity 

n 

E[n] = ^2\h[m]\ 2 

m = 

is maximum for all n > when h[n] is the minimum-phase sequence. This result is proved as 
follows: Let/i m i n [n] be a minimum-phase sequence with z-transform H m i n (z). Furthermore, 
let Zk be a zero of H m \ n {z) so that we can express H m \ n {z) as 

H min (z) = Q(z)(\ - ZkZ- 1 ), \Zk\ < 1. 

where Q (z) is again minimum phase. Now consider another sequence h[n] with z-transform 
H{z) such that 

\H{ei»)\ = \H min (e j(0 )\ 

and such that H(z) has a zero at z — l/z% instead of at zk- 

(a) Express H(z) in terms of Q(z). 

(b) Express h[n] and /t m i n [n] in terms of the minimum-phase sequence q[n] that has 
z-transform Q(z). 

(c) To compare the distribution of energy of the two sequences, show that 

n n 

£ = 53 l^minMl 2 - ^ I*WI 2 = (1 - l*fc| 2 )l*[«]| 2 - 
m=0 m=0 

(d) Using the result of Part (c), argue that 



J] lMm]| 2 < 53 l*™nMl 2 for all n. 



m = m = 

5.67. A causal all-pass system // ap (z) has input x[n] and output y[ri\. 

(a) If x[n] is a real minimum-phase sequence (which also implies that x[n] = for n < 0), 
using Eq. (5.118), show that 

n n 

53i*[*]i 2 ^X>[*i |2 - (P 5 - 67 - 1 ) 

*=0 k=0 

(b) Show that Eq. (P5.67-1) holds even if x[n] is not minimum phase, but is zero for n < 0. 

5.68. In the design of either continuous-time or discrete-time filters, we often approximate a spec- 
ified magnitude characteristic without particular regard to the phase. For example, standard 
design techniques for lowpass and bandpass filters are derived from a consideration of the 
magnitude characteristics only. 

In many filtering problems, we would prefer that the phase characteristics be zero 
or linear. For causal filters, it is impossible to have zero phase. However, for many filtering 
applications, it is not necessary that the impulse response of the filter be zero for n < if 
the processing is not to be carried out in real time. 

One technique commonly used in discrete-time filtering when the data to be filtered 
are of finite duration and are stored, for example, in computer memory is to process the 
data forward and then backward through the same filter. 

Let h[n] be the impulse response of a causal filter with an arbitrary phase character- 
istic. Assume that h[n] is real, and denote its Fourier transform by H(e }0> ). Let x[n] be the 
data that we want to filter. 
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(a) Method A: The filtering operation is performed as shown in Figure P5.68-1. 





h[n] 




x[n] 


g[n] 










h[n] 




g[~n] 


r[n] 



s[n] = r[-n] 



Figure P5.68-1 



1. Determine the overall impulse response h\[n] that relates x[n] to s[n], and show 
that it has a zero-phase characteristic. 

2. Determine \Hi(e ia> )\, and express it in terms of\H(e ia> )\ and <H(e iw ). 

(b) Method B: As depicted in Figure P5.68b-2, process x[n] through the filter h[n] to get 
g[n]. Also, process x[n] backward through h[n] to get r[ri\. The output y[n] is then taken 
as the sum of g[n] and r[— n]. This composite set of operations can be represented by 
a filter with input x[n], output y[n\, and impulse response h2[n]. 





h[n] 




x[n] 


g[n] 










h[n] 




x[-n] 


r[n] 



y [n]=g[n] + r[-n] 



Figure P5.68-2 



1. Show that the composite filter h2[n] has a zero-phase characteristic. 

2. Determine \H 2 (e ico )\, and express it in terms of \H(e ict) )\ and <H(e' a) ). 

(c) Suppose that we are given a sequence of finite duration on which we would like to 
perform a bandpass zero-phase filtering operation. Furthermore, assume that we are 
given the bandpass filter h[n], with frequency response as specified in Figure P5.68-3, 
which has the magnitude characteristic that we desire, but has linear phase. To achieve 
zero phase, we could use either method A or B. Determine and sketch \Hi(e^)\ and 
\H2(ei { °)\. From these results, which method would you use to achieve the desired 
bandpass filtering operation? Explain why. More generally, if h[n] has the desired mag- 
nitude, but a nonlinear phase characteristic, which method is preferable to achieve a 
zero-phase characteristic? 



\H(ei~)\ 




Figure P5.68-3 
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5.69. Determine whether the following statement is true or false. If it is true, concisely state your 
reasoning. If it is false, give a counterexample. 

Statement: If the system function H(z) has poles anywhere other than at the origin or 
infinity, then the system cannot be a zero-phase or a generalized linear-phase system. 

5.70. Figure P5.70-1 shows the zeros of the system function H{z) for a real causal linear- phase FIR 
filter. All of the indicated zeros represent factors of the form (1 - az~ l ). The corresponding 
poles at z — for these factors are not shown in the figure. The filter has approximately 
unity gain in its passband. 

(a) One of the zeros has magnitude 0.5 and angle 153 degrees. Determine the exact location 
of as many other zeros as you can from this information. 

(b) The system function H{z) is used in the system for discrete-time processing of continuous 
time signals shown in Figure 4.11, with the sampling period T = 0.5 msec. Assume that 
the continuous-time input X c (jU) is bandlimited and that the sampling rate is high 
enough to avoid aliasing. What is the time delay (in msec) through the entire system, 
assuming that both C/D and D/C conversion require negligible amounts of time? 

(c) For the system in Part (b), sketch the overall effective continuous-time frequency re- 
sponse 201og 10 |// e ff(;'£2)| for < U < nf T as accurately as possible using the given 
information. Estimate the frequencies at which // e ffO &) = 0, and mark them on your 
plot. 



_ 0.5 



a, 

c 
"5b 

S 
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Real part 



Figure P5.70-1 



5.71. A signal x[n] is processed through an LTI system H(z) and then downsampled by a factor 
of 2 to yield y[n] as indicated in Figure P5.71-1. Also, as shown in the same figure, x[n] is 
first downsampled and then processed through an LTI system G(z) to obtain r[n]. 
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(a) Specify a choice for H(z) (other than a constant) and G(z) so that r[n] = y[n] for an 
arbitrary x[n]. 

(b) Specify a choice for H(z) so that there is no choice for G(z) that will result in r[n] = y[n] 
for an arbitrary x[ri\. 



x[n] 



H(z) 



w[n] 



\2 



y[n] = w[2n] 



x[n] 



\2 



s\n] = w[2n] 



G(z) 



r[n] 



Figure P5.71-1 



(c) Determine as general a set of conditions as you can on H(z) such that G(z) can be 
chosen so that r[n] = y[n] for an arbitrary x[ri\. The conditions should not depend on 
x[n\. If you first develop the conditions in terms of h[n], restate them in terms of H(z). 

(d) For the conditions determined in Part (c), what is g[n] in terms of h[n] so that r[n] = 

y[n\ 

5.72. Consider a discrete-time LTI system with a real-valued impulse response h[ri\. We want to 
find h[n], or equivalently, the system function H(z) from the autocorrelation c^[t] of the 
impulse response. The definition of the autocorrelation is 



Chh[t]= J2 M*M* + fl- 



k=—oo 

(a) If the system h[n] is causal and stable, can you uniquely recover h[n] from cm[£]? Justify 
your answer. 

(b) Assume that h[n] is causal and stable and that, in addition, you know that the system 
function has the form 

H(z) = X 



1 - EL a kz~ k 

for some finite a*- Can you uniquely recover h[n] from c/,/,[^]? Clearly justify your 
answer. 

5.73. Let h[n] and H(z) denote the impulse response and system function of a stable all-pass LTI 
system. Let hi[n] denote the impulse response of the (stable) LTI inverse system. Assume 
that h[n] is real. Show that /i,[n] = /*[-«]. 

5.74. Consider a real-valued sequence x[n] for which X{e ia> ) = for j < \a)\ < n. One sequence 
value of x[n] may have been corrupted, and we would like to recover it approximately or 
exactly. With g[n] denoting the corrupted signal, 

g[n]-*[n] forn^/to, 

and g[no] is real but not related to *[/zo]- In each of the following two cases, specify a 
practical algorithm for recovering x[n] from g[n] exactly or approximately. 

(a) The exact value of no is not known, but we know that «o is an odd number. 

(b) Nothing about no is known. 

5.75. Show that if h[n] is an N-point FIR filter such that h[n] = h[N - 1 - n] and H(zq) = 0, 
then H(l/zo) = 0. This shows that even symmetric linear-phase FIR filters have zeros that 
are reciprocal images. (If h[n] is real, the zeros also will be real or will occur in complex 
conjugates.) 
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Structures for 
discrete-time systems 



6.0 INTRODUCTION 

As we saw in Chapter 5, a linear time-invariant system with a rational system function has 
the property that the input and output sequences satisfy a linear constant-coefficient dif- 
ference equation. Since the system function is the z-transform of the impulse response, 
and since the difference equation satisfied by the input and output can be determined 
by inspection of the system function, it follows that the difference equation, the impulse 
response, and the system function are equivalent characterizations of the input-output 
relation of a linear time-invariant discrete-time system. When such systems are imple- 
mented with discrete-time analog or digital hardware, the difference equation or the sys- 
tem function representation must be converted to an algorithm or structure that can be 
realized in the desired technology. As we will see in this chapter, systems described by lin- 
ear constant-coefficient difference equations can be represented by structures consisting 
of an interconnection of the basic operations of addition, multiplication by a constant, 
and delay, the exact implementation of which is dictated by the technology to be used. 
As an illustration of the computation associated with a difference equation, con- 
sider the system described by the system function 



bo + hz ' 1 
1 — az' 



H(z)= y __ x , k|>|n|. (6.1) 



The impulse response of this system is 

h[n] = b a n u[n] + M" _1 «[" - 1]. (6.2) 
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and the first-order difference equation that is satisfied by the input and output sequences 

is 

y[n] — ay[n — 1] = £>o*M + b\x[n — 1]. (63) 

Since the system has an infinite-duration impulse response, it is not possible to 
implement the system by discrete convolution. However, rewriting Eq. (63) in the form 

y[n] = ay[n - 1] + b x[n] + bix[n - 1] (6.4) 

provides the basis for an algorithm for recursive computation of the output at any time 
n in terms of the previous output y[n — 1], the current input sample x[n], and the previ- 
ous input sample x[n — 1]. As discussed in Section 2.5, if we further assume initial-rest 
conditions (i.e., if x[n] = Oforn < 0, then y[n] =0for/z < 0), and if weuseEq. (6,4) as a 
recurrence formula for computing the output from past values of the output and present 
and past values of the input, the system will be linear and time invariant. A similar pro- 
cedure can be applied to the more general case of an Mh-order difference equation. 
However, the algorithm suggested by Eq. (6.4) and its generalization for higher order 
difference equations is not the only computational algorithm for implementing a partic- 
ular system, and often it is not the most preferable. As we will see, an unlimited variety 
of computational structures result in the same relation between the input sequence x[n] 
and the output sequence y[ri\. 

In the remainder of this chapter, we consider the important issues in the imple- 
mentation of linear time-invariant discrete-time systems. We first present the block 
diagram and signal flow graph descriptions of computational structures or networks 
for linear constant-coefficient difference equations representing linear time-invariant 
causal systems. Using a combination of algebraic manipulations and manipulations of 
block diagram representations, we derive a number of basic equivalent structures for 
implementing a causal linear time-invariant system. Although two structures may be 
equivalent with regard to their input-output characteristics for infinite-precision repre- 
sentations of coefficients and variables, they may have vastly different behavior when 
the numerical precision is limited. This is the major reason that it is of interest to study 
different implementation structures. The effects of finite-precision representation of 
the system coefficients and the effects of truncation or rounding of intermediate com- 
putations are considered in the latter sections of the chapter. 



6.1 BLOCK DIAGRAM REPRESENTATION OF LINEAR 
CONSTANT-COEFFICIENT DIFFERENCE EQUATIONS 

The implementation of a linear time-invariant discrete-time system by iteratively eval- 
uating a recurrence formula obtained from a difference equation requires that delayed 
values of the output, input, and intermediate sequences be available. The delay of se- 
quence values implies the need for storage of past sequence values. Also, we must 
provide means for multiplication of the delayed sequence values by the coefficients, 
as well as means for adding the resulting products. Therefore, the basic elements re- 
quired for the implementation of a linear time-invariant discrete-time system are adders, 
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Figure 6.1 Block diagram symbols. 

(a) Addition of two sequences. 

(b) Multiplication of a sequence by a 
constant, (c) Unit delay. 



multipliers, and memory for storing delayed sequence values. The interconnection of 
these basic elements is conveniently depicted by block diagrams composed of the ba- 
sic pictorial symbols shown in Figure 6.1. Figure 6.1(a) represents the addition of two 
sequences. In general block diagram notation, an adder may have any number of in- 
puts. However, in almost all practical implementations, adders have only two inputs. 
In all the diagrams of this chapter, we indicate this explicitly by limiting the num- 
ber of inputs as in Figure 6.1(a). Figure 6.1(b) depicts multiplication of a sequence 
by a constant, and Figure 6.1(c) depicts delaying a sequence by one sample. In digi- 
tal implementations, the delay operation can be implemented by providing a storage 
register for each unit delay that is required. In analog discrete-time implementations, 
such as switched-capacitor filters, the delays are implemented by charge storage de- 
vices. The unit delay system is represented in Figure 6.1(c) by its system function, z~ l . 
Delays of more than one sample can be denoted as in Figure 6.1(c), with a system 
function of z~ M , where M is the number of samples of delay; however, the actual im- 
plementation of M samples of delay would generally be done by cascading M unit 
delays. In an integrated-circuit implementation, these unit delays might form a shift 
register that is clocked at the sampling rate of the input signal. In a software imple- 
mentation, M cascaded unit delays would be implemented as M consecutive memory 
registers. 



Example 6. 1 Block Diagram Representation 
of a Difference Equation 

As an example of the representation of a difference equation in terms of the elements 
in Figure 6.1, consider the second-order difference equation 



y[n] = a\y[n - 1] + a 2 y[n - 2] + b x[n]. 
The corresponding system function is 

H{z) = ^ 

v ' 1 - aiz" 1 - a 2 z~ 2 



(6.5) 



(6.6) 



The block diagram representation of the system realization based on Eq. (6.5) is 
shown in Figure 6.2. Such diagrams give a pictorial representation of a computational 
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Figure 6.2 Example of a block diagram representation of a difference equation. 



algorithm for implementing the system. When the system is implemented on either a 
general-purpose computer or a digital signal processing (DSP) chip, network structures 
such as the one shown in Figure 6.2 serve as the basis for a program that implements 
the system. If the system is implemented with discrete components or as a complete 
system with VLSI technology, the block diagram is the basis for determining a hardware 
architecture for the system. In both cases, diagrams such as Figure 6.2 show explicitly 
that we must provide storage for the delayed variables (in this case, y[n — 1] and 
y[n — 2]) and also the coefficients of the difference equation (in this case, a\, a2, 
and bo). Furthermore, we see from Figure 6.2 that an output sequence value y[n] 
is computed by first forming the products a\y[n — 1] and aiy[n — 2], then adding 
them, and, finally, adding the result to Z>oJt[rt]. Thus, Figure 6.2 conveniently depicts 
the complexity of the associated computational algorithm, the steps of the algorithm, 
and the amount of hardware required to realize the system. 

Example 6.1 can be generalized to higher order difference equations of the form 1 



N 



M 



yW - ^2 aky [ n ~ ^ = 5Z bkX ^ n ~ k ]> 



(6.7) 



A:=l 



A:=0 



with the corresponding system function 



H(z) = 



M 



£<«-* 



Jt=0 



N 



(6.8) 



i-E 



dkZ 



k=\ 



lr The form used in previous chapters for a general Mh-order difference equation was 

N M 

y aky[n - k] = N bkx[n - k\. 



k=0 



Jt=0 



In the remainder of the book, it will be more convenient to use the form in Eq. (6.7), where the coefficient 
of y[n] is normalized to unity and the coefficients associated with the delayed output appear with a positive 
sign after they have been moved to the right-hand side of the equation. (See Eq. (6.9).) 
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Figure 6.3 Block diagram 
representation for a general A/th-order 
difference equation. 



Rewriting Eq. (6.7) as a recurrence formula for y[n] in terms of a linear combination of 
past values of the output sequence and current and past values of the input sequence 
leads to the relation 

N M 

y[n] = J2 Win - *1 + £ *> k x[n - k]. (6.9) 



*=1 



k=0 



The block diagram of Figure 6.3 is an explicit pictorial representation of Eq. (6.9). 
More precisely, it represents the pair of difference equations 



M 



V W = ^b k x[n-k], 



Jt=0 

N 



yW = ^2 a ky[n-k] + v[n]. 



(6.10a) 



(6.10b) 



Jt=i 



The assumption of a two-input adder implies that the additions are done in a specified 
order. That is, Figure 6.3 shows that the products a^y[n — N] and a^_\y[n — N + 1] 
must be computed, then added, and the resulting sum added to aN-iy[n — N + 2], and 
so on. After y[n] has been computed, the delay variables must be updated by moving 
y[n — N+ 1] into the register holding y[n — N], and so on. 

A block diagram can be rearranged or modified in a variety of ways without chang- 
ing the overall system function. Each appropriate rearrangement represents a different 
computational algorithm for implementing the same system. For example, the block 
diagram of Figure 6.3 can be viewed as a cascade of two systems, the first representing 
the computation of v[n] from x[n] and the second representing the computation of y[n] 
from v[n]. Since each of the two systems is a linear time-invariant system (assuming 
initial-rest conditions for the delay registers), the order in which the two systems are 
cascaded can be reversed, as shown in Figure 6.4, without affecting the overall system 
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Figure 6.4 Rearrangement of block 
diagram of Figure 6.3. We assume for 
convenience that N — M. If N ^ M, 
some of the coefficients will be zero. 



function. In Figure 6.4, for convenience, we have assumed that M = N. Clearly, there 
is no loss of generality, since if M ^ N, some of the coefficients ak or bk in the figure 
would be zero, and the diagram could be simplified accordingly. 

In terms of the system function H(z) in Eq. (6.8), Figure 6.3 can be viewed as an 
implementation of H(z) through the decomposition 



/ 



H{z) = // 2 (z)//i(z) = 



\ 



N 



\ 



k=\ 



M 



M 



£*«-* 



(6.11) 



k=0 



J 



i-J2 akz 

or, equivalently, through the pair of equations 

V(z) = Hi(z)X(z) = \Y,b k z- k I X(z), 

I \ 



(6.12a) 



Y(z) = H 2 (z)V{z) = 



N 



\ k=i 



V(z). 



(6.12b) 



/ 
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Figure 6.4, on the other hand, represents H{z) as 



H(z) = H l (z)H 2 (z)= (X>*~*j 

\A:=0 / 



/ \ 

1 

N 

i _ y a k z~ k 



(6.13) 



or, equivalently, through the equations 



W(z) = H 2 (z)X(z) = 



I \ 

1 



N 



i-E««-* 



X{z\ 



(6.14a) 



*=i 



/ 



Y(z) = //i(z)W(z) = ( $>**"*) W(z). 



(6.14b) 



In the time domain, Figure 6.4 and, equivalently, Eqs. (6.14a) and (6.14b) can be rep- 
resented by the pair of difference equations 



N 



w[n] = V^ a k w[n — k] + x[n], 



M 



yW = Yl bkW l n ~ k ]- 



(6.15a) 



(6.15b) 



A:=0 



The block diagrams of Figures 6.3 and 6.4 have several important differences. In 
Figure 6.3, the zeros of H(z), represented by Hi(z), are implemented first, followed by 
the poles, represented by H2(z). In Figure 6.4, the poles are implemented first, followed 
by the zeros. Theoretically, the order of implementation does not affect the overall 
system function. However, as we will see, when a difference equation is implemented 
with finite-precision arithmetic, there can be a significant difference between two sys- 
tems that are theoretically equivalent. Another important point concerns the number 
of delay elements in the two systems. As drawn, the systems in Figures 6.3 and 6.4 each 
have a total of(N+M) delay elements. However, the block diagram of Figure 6.4 can 
be redrawn by noting that exactly the same signal, w[n], is stored in the two chains of 
delay elements in the figure. Consequently, the two can be collapsed into one chain, as 
indicated in Figure 6.5. 

The total number of delay elements in Figure 6.5 is less than in either Figure 6.3 
or Figure 6.4, and in fact it is the minimum number required to implement a system 
with system function given by Eq. (6.8). Specifically, the minimum number of delays 
required is, in general, max(A^, M). An implementation with the minimum number of 
delay elements is commonly referred to as a canonic form implementation. The non- 
canonic block diagram in Figure 6.3 is referred to as the direct form I implementation 
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Combination of delays in 



of the general Mh-order system because it is a direct realization of the difference equa- 
tion satisfied by the input x[n] and the output y[n], which in turn can be written directly 
from the system function by inspection. Figure 6.5 is often referred to as the direct 
form II or canonic direct form implementation. Knowing that Figure 6.5 is an appropri- 
ate realization structure for H(z) given by Eq. (6.8), we can go directly back and forth 
in a straightforward manner between the system function and the block diagram (or 
the equivalent difference equation). 



Example 6.2 Direct Form I and Direct Form II 
Implementation of an LTI System 

Consider the LTI system with system function 



m = 



1 + 2*" 1 



l-l.Sz-i+O.^- 2 



(6.16) 



Comparing this system function with Eq. (6.8), we find bo = 1, b\ = 2, a\ = +1.5, 
and a2 = —0.9, so it follows from Figure 6.3 that we can implement the system in a 
direct form I block diagram as shown in Figure 6.6. Referring to Figure 6.5, we can also 
implement the system function in direct form II, as shown in Figure 6.7. In both cases, 
note that the coefficients in the feedback branches in the block diagram have opposite 
signs from the corresponding coefficients of z -1 and z~ 2 in Eq. (6.16). Although this 
change of sign is sometimes confusing, it is essential to remember that the feedback 
coefficients {a^} always have the opposite sign in the difference equation from their 
sign in the system function. Note also that the direct form II requires only two delays 
to implement H{z), one less than the direct form I implementation. 
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Figure 6.6 Direct form I implementation of Eq. (6.16). 
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Figure 6.7 Direct form II implementation of Eq. (6.16). 

In the preceding discussion, we developed two equivalent block diagrams for 
implementing a linear time-invariant system with system function given by Eq. (6.8). 
These block diagrams, which represent different computational algorithms for imple- 
menting the system, were obtained by manipulations based on the linearity of the system 
and the algebraic properties of the system function. Indeed, since the basic difference 
equations that represent a linear time -invariant system are linear, equivalent sets of dif- 
ference equations can be obtained simply by linear transformations of the variables of 
the difference equations. Thus, there are an unlimited number of equivalent realizations 
of any given system. In Section 6.3, using an approach similar to that employed in this 
section, we will develop a number of other important and useful equivalent structures 
for implementing a system with system function as in Eq. (6.8). Before discussing these 
other forms, however, it is convenient to introduce signal flow graphs as an alternative 
to block diagrams for representing difference equations. 

6.2 SIGNAL FLOW GRAPH REPRESENTATION OF LINEAR 
CONSTANT-COEFFICIENT DIFFERENCE EQUATIONS 



A signal flow graph representation of a difference equation is essentially the same as 
a block diagram representation, except for a few notational differences. Formally, a 
signal flow graph is a network of directed branches that connect at nodes. Associated 
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Figure 6.8 Example of nodes and 
branches in a signal flow graph. 
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Figure 6.9 Example of a signal flow 
graph showing source and sink nodes. 



with each node is a variable or node value. The value associated with node k might 
be denoted wjt, or, since node variables for digital filters are generally sequences, we 
often indicate this explicitly with the notation vc*[ft]- Branch (/, k) denotes a branch 
originating at node / and terminating at node k, with the direction from j to k being 
indicated by an arrowhead on the branch. This is shown in Figure 6.8. Each branch 
has an input signal and an output signal. The input signal from node / to branch (/, k) 
is the node value Wj[n]. In a linear signal flow graph, which is the only class we will 
consider, the output of a branch is a linear transformation of the input to the branch. 
The simplest example is a constant gain, i.e., when the output of the branch is simply a 
constant multiple of the input to the branch. The linear operation represented by the 
branch is typically indicated next to the arrowhead showing the direction of the branch. 
For the case of a constant multiplier, the constant is simply shown next to the arrowhead. 
When an explicit indication of the branch operation is omitted, this indicates a branch 
transmittance of unity, or the identity transformation. By definition, the value at each 
node in a graph is the sum of the outputs of all the branches entering the node. 

To complete the definition of signal flow graph notation, we define two special 
types of nodes. Source nodes are nodes that have no entering branches. Source nodes 
are used to represent the injection of external inputs or signal sources into a graph. 
Sink nodes are nodes that have only entering branches. Sink nodes are used to extract 
outputs from a graph. Source nodes, sink nodes, and simple branch gains are illustrated 
in the signal flow graph of Figure 6.9. The linear equations represented by the figure 
are as follows: 



w\ [n] = x[n] + aw 2 [n] + bw 2 [n], 
w 2 [n] = cwi[n], 
y[n] = dx[n] + en^l/*]. 



(6.17) 



Addition, multiplication by a constant, and delay are the basic operations required 
to implement a linear constant-coefficient difference equation. Since these are all lin- 
ear operations, it is possible to use signal flow graph notation to depict algorithms for 
implementing linear time-invariant discrete-time systems. As an example of how the 
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flow graph concepts just discussed can be applied to the representation of a difference 
equation, consider the block diagram in Figure 6.10(a), which is the direct form II real- 
ization of the system whose system function is given by Eq. (6.1). A signal flow graph 
corresponding to this system is shown in Figure 6.10(b). In the representation of differ- 
ence equations, the node variables are sequences. In Figure 6.10(b), node is a source 
node whose value is determined by the input sequence x[n], and node 5 is a sink node 
whose value is denoted y[n]. Notice that the source and sink nodes are connected to 
the rest of the graph by unity-gain branches to clearly denote the input and output 
of the system. Obviously, nodes 3 and 5 have identical values. In Figure 6.10(b), all 
branches except one (the delay branch (2, 4)) can be represented by a simple branch 
gain; i.e., the output signal is a constant multiple of the branch input. A delay cannot 
be represented in the time domain by a branch gain. However, the z-transform rep- 
resentation of a unit delay is multiplication by the factor z~ l . If we represented the 
difference equations by their corresponding z-transform equations, all the branches 
would be characterized by their system functions. In this case, each branch gain would 
be a function of z; e.g., a unit delay branch would have a gain of z _1 . By convention, we 
represent the variables in a signal flow graph as sequences rather than as z-transforms 
of sequences. However, to simplify the notation, we normally indicate a delay branch 
by showing its branch gain as z~\ but it is understood that the output of such a branch 
is the branch input delayed by one sequence value. The graph of Figure 6.10(b) is 
shown in Figure 6.1 1 with this convention. The equations represented by Figure 6.1 1 are 
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Figure 6.10 (a) Block diagram 
representation of a first-order digital 
filter, (b) Structure of the signal flow 
graph corresponding to the block 
diagram in (a). 




Figure 6.11 Signal flow graph of 
Figure 6.10(b) with the delay branch 
indicated by z~ 1 . 
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as follows: 

wi[n] = flW4[«] +^[n], (6.18a) 

w 2 [n] = ivi[n], (6.18b) 

w 3 [n] = b Q w 2 [n] + biu^fn], (6.18c) 

w 4 [n] = w 2 [n-l], (6.18d) 

y[n] = w 3 [n], (6.18e) 

A comparison of Figure 6.10(a) and Figure 6.11 shows that there is a direct corre- 
spondence between branches in the block diagram and branches in the flow graph. In 
fact, the important difference between the two is that nodes in the flow graph represent 
both branching points and adders, whereas in the block diagram a special symbol is used 
for adders. A branching point in the block diagram is represented in the flow graph by a 
node that has only one incoming branch and one or more outgoing branches. An adder 
in the block diagram is represented in the signal flow graph by a node that has two (or 
more) incoming branches. Signal flow graphs are therefore totally equivalent to block 
diagrams as pictorial representations of difference equations, but they are simpler to 
draw. Like block diagrams, they can be manipulated graphically to gain insight into 
the properties of a given system. A large body of signal flow graph theory exists that 
can be directly applied to discrete-time systems when they are represented in this form. 
(See Mason and Zimmermann, 1960; Chow and Cassignol, 1962; and Phillips and Nagle, 
1995.) Although we will use flow graphs primarily for their pictorial value, we will utilize 
certain theorems relating to signal flow graphs in examining alternative structures for 
implementing linear systems. 

Equations (6.18a )-(6.18e) define a multistep algorithm for computing the out- 
put of the linear time-invariant system from the input sequence x[n]. This example 
illustrates the kind of data precedence relations that generally arise in the implementa- 
tion of IIR systems. Equations (6.18a)-(6.18e) cannot be computed in arbitrary order. 
Equations (6.18a) and (6.18c) require multiplications and additions, but Eqs. (6.18b) 
and (6.18e) simply rename variables. Equation (6.18d) represents the "updating" of the 
memory of the system. It would be implemented simply by replacing the contents of 
the memory register representing W4[n] by the value of w 2 [/z], but this would have to be 
done consistently either before or after the evaluation of all the other equations. Initial- 
rest conditions would be imposed in this case by defining w 2 [— 1] = or W4[0] = 0. 
Clearly, Eqs. (6.18a)-(6.18e) must be computed in the order given, except that the last 
two could be interchanged or Eq. (6.18d) could be consistently evaluated first. 

The flow graph represents a set of difference equations, with one equation being 
written at each node of the network. In the case of the flow graph of Figure 6.11, we 
can eliminate some of the variables rather easily to obtain the pair of equations 

w 2 [n] = aw 2 [n — 1] + x[n], (6.19a) 

y[n] = bow 2 [n] + b\w 2 [n — 1], (6.19b) 

which are in the form of Eqs. (6.15a) and (6.15b); i.e., in direct form II. Often, the 
manipulation of the difference equations of a flow graph is difficult when dealing with 
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the time-domain variables, due to feedback of delayed variables. In such cases, it is 
always possible to work with the ^-transform representation, wherein all branches are 
simple gains. Problems 6.1-6.26 illustrate the utility of z- transform analysis of flow 
graphs for obtaining equivalent sets of difference equations. 



Example 6.3 Determination of the System Function 
from a Flow Graph 

To illustrate the use of the ^-transform in determining the system function from a 
flow graph, consider Figure 6.12. The flow graph in this figure is not in direct form. 
Therefore, the system function cannot be written down by inspection of the graph. 
However, the set of difference equations represented by the graph can be written 
down by writing an equation for the value of each node variable in terms of the other 
node variables. The five equations are 



wi[n] = w 4 [«]- x[n], 
w 2 [n] = awi[n], 
w 3 [/i] = W2[/t] + Jt[n], 
w 4 [n] = w 3 [n - 1], 
y[n] = w 2 [n] + w 4 [n\. 



(6.20a) 
(6.20b) 
(6.20c) 
(6.20d) 
(6.20e) 



-1 "il"] a w i\- n \ 




w 3 [n] z l w 4 [n] 
Figure 6.12 Flow graph not in standard direct form. 



These are the equations that would be used to implement the system in the form 
described by the flow graph. Equations (6.20a)-(6.20e) can be represented by the 
z-transform equations 



Wi(z) = W 4 (z) - X(z), 
W 2 (z) = e*Wi(z), 

W 3 (z) = W 2 {z) + X{z), 
W 4 (z) = z^Wsiz), 
Y(z) = W 2 (z) + W 4 (z). 



(6.21a) 
(6.21b) 
(6.21c) 
(6.21d) 
(6.21e) 
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We can eliminate W\ (z) and W3 (z) from this set of equations by substituting Eq. (6.21a) 
into Eq. (6.21b) and Eq. (6.21c) into Eq. (6.21d), obtaining 

W 2 (z) = a(W,(z) - X(z)), (6.22a) 

W 4 (z) = z- l (W 2 (z) + X(z)), (6.22b) 

Y(z) = W 2 (z) + W 4 (z). (6.22c) 
Equations (6.22a) and (6.22b) can be solved for W 2 (z) and W 4 (z), yielding 

a(z~ l - 1) 
W 2 (z)=-f ^X(z), (6.23a) 

1 — OLZ l 

z'Hl -a) 

W 4 (z) = =-+ y-X{z\ (6.23b) 

1 — az~ l 

and substituting Eqs. (6.23a) and (6.23b) into Eq. (6.22c) leads to 



Y( z) = | g(; ''- 1) + ; ;' (1 - g) ) X(z) = ' z 



-1 



a 



1 — az~ l J \1 — az~ l 

Therefore, the system function of the flow graph of Figure 6.12 is 



X(z). (6.24) 



H(z) = 



z ] - a 



1 — ctz~ l ' 
from which it follows that the impulse response of the system is 

h[n]=a n - l u[n-l]-a n+l u[n] 

and the direct form I flow graph is as shown in Figure 6.13. 



(6.25) 





x[n] 



y[n] 



Figure 6.13 Direct form I equivalent of Figure 6.1 2. 



Example 6.3 shows how the z-transform converts the time-domain expressions, 
which involve feedback and thus are difficult to solve, into linear equations that can be 
solved by algebraic techniques. The example also illustrates that different flow graph 
representations define computational algorithms that require different amounts of com- 
putational resources. By comparing Figures 6.12 and 6.13, we see that the original im- 
plementation requires only one multiplication and one delay (memory) element, while 
the direct form I implementation would require two multiplications and two delay ele- 
ments. The direct form II implementation would require one less delay, but it still would 
require two multiplications. 
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6.3 BASIC STRUCTURES FOR IIR SYSTEMS 

In Section 6.1, we introduced two alternative structures for implementing a linear time- 
invariant system with system function as in Eq. (6.8). In this section we present the 
signal flow graph representations of those systems, and we also develop several other 
commonly used equivalent flow graph network structures. Our discussion will make 
it clear that, for any given rational system function, a wide variety of equivalent sets 
of difference equations or network structures exists. One consideration in the choice 
among these different structures is computational complexity. For example, in some 
digital implementations, structures with the fewest constant multipliers and the fewest 
delay branches are often most desirable. This is because multiplication is generally 
a time-consuming and costly operation in digital hardware and because each delay 
element corresponds to a memory register. Consequently, a reduction in the number 
of constant multipliers means an increase in speed, and a reduction in the number of 
delay elements means a reduction in memory requirements. 

Other, more subtle, trade-offs arise in VLSI implementations, in which the area 
of a chip is often an important measure of efficiency. Modularity and simplicity of data 
transfer on the chip are also frequently very desirable in such implementations. In 
multiprocessor implementations, the most important considerations are often related 
to partitioning of the algorithm and communication requirements between processors. 
Another major consideration is the effects of a finite register length and finite-precision 
arithmetic. These effects depend on the way in which the computations are organized, 
i.e., on the structure of the signal flow graph. Sometimes it is desirable to use a structure 
that does not have the minimum number of multipliers and delay elements if that 
structure is less sensitive to finite register length effects. 

In this section, we develop several of the most commonly used forms for imple- 
menting a linear time-invariant IIR system and obtain their flow graph representations. 

6.3.1 Direct Forms 

In Section 6.1, we obtained block diagram representations of the direct form I (Fig- 
ure 6.3) and direct form II, or canonic direct form (Figure 6.5), structures for a linear 
time-invariant system whose input and output satisfy a difference equation of the form 

N M 

yty\ - 5Z aky ^ n ~ *] = XI bkX ^ n ~ *!' ( 6 - 26 ) 

k=l k=0 

with the corresponding rational system function 

M 



!>-* 



H(z) = -^5 . (6.27) 

k=\ 

In Figure 6.14, the direct form I structure of Figure 6.3 is shown using signal flow graph 
conventions, and Figure 6.15 shows the signal flow graph representation of the direct 
form II structure of Figure 6.5. Again, we have assumed for convenience that N = M. 
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x[n-N+l]i> 



x[n-N]i> 



°y[n-N] 



Figure 6.14 Signal flow graph of direct form I structure for an A/th-order system. 
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Figure 6.15 Signal flow graph of 
direct form II structure for an 
A/th-order system. 



Note that we have drawn the flow graph so that each node has no more than two inputs. 
A node in a signal flow graph may have any number of inputs, but, as indicated earlier, 
this two-input convention results in a graph that is more closely related to programs and 
architectures for implementing the computation of the difference equations represented 
by the graph. 



Example 6.4 Illustration of Direct Form I and Direct 
Form II Structures 



Consider the system function 

H{z) = 



1 + 2z~ l + z~ 2 



(6.28) 



l-0.15z- l +0.125z- 2 ' 
Since the coefficients in the direct form structures correspond directly to the coeffi- 
cients of the numerator and denominator polynomials (taking into account the minus 
sign in the denominator of Eq. (6.27)), we can draw these structures by inspection with 
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reference to Figures 6.14 and 6.15. The direct form I and direct form II structures for 
this example are shown in Figures 6.16 and 6.17, respectively. 



O > O » O » ■ Q > O- 



x[n] 





y[n] 



Figure 6.16 Direct form I structure for Example 6.4. 



o > o * p *■ o * o 



x[n] 



0.75 
6 « 6- 



-0.125 

— « 6 *~- 



,-\ 



4 



y[n] 



Figure 6.17 Direct form II structure for Example 6.4. 



6.3.2 Cascade Form 

The direct form structures were obtained directly from the system function H(z), written 
as a ratio of polynomials in the variable z" 1 as in Eq. (6.27). If we factor the numerator 
and denominator polynomials, we can express H(z) in the form 



Mi 



M 2 



II* 1 - A*" 1 ) II^ - s**" 1 )* 1 - sU~ l ) 



H(z) - A 



k=l 



Jfc=l 



M N 2 

rj(i - c k z- 1 ) n(i - d k z- l )(\ - d- kZ - 1 ) 

*=1 k=l 



(6.29) 



where M — M\ + 2M2 and N = N\ + 2fy. In this expression, the first-order factors 
represent real zeros at fk and real poles at c*, and the second-order factors represent 
complex conjugate pairs of zeros at gk and g* k and complex conjugate pairs of poles at 
dk and d\. This represents the most general distribution of poles and zeros when all the 
coefficients in Eq. (6.27) are real. Equation (6.29) suggests a class of structures consisting 
of a cascade of first- and second-order systems. There is considerable freedom in the 
choice of composition of the subsystems and in the order in which the subsystems are 
cascaded. In practice, however, it is often desirable to implement the cascade realization 
using a minimum of storage and computation. A modular structure that is advantageous 
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Figure 6.18 Cascade structure for a sixth-order system with a direct form II 
realization of each second-order subsystem. 



for many types of implementations is obtained by combining pairs of real factors and 
complex conjugate pairs into second-order factors so that Eq. (6.29) can be expressed as 



N s 



u< \ TT b ok + bi k z ] +b lk z 2 



aikZ~ l - a 2 kZ~ 2 



(6.30) 



where N s = [(N + 1)/2J is the largest integer contained in (N + l)/2. In writing 
H(z) in this form, we have assumed that M < N and that the real poles and 
zeros have been combined in pairs. If there are an odd number of real zeros, one 
of the coefficients bik will be zero. Likewise, if there are an odd number of real 
poles, one of the coefficients ajk will be zero. The individual second-order sections 
can be implemented using either of the direct form structures; however, the previous 
discussion shows that we can implement a cascade structure with a minimum num- 
ber of multiplications and a minimum number of delay elements if we use the direct 
form II structure for each second-order section. A cascade structure for a sixth-order 
system using three direct form II second-order sections is shown in Figure 6.18. The 
difference equations represented by a general cascade of direct form II second-order 
sections are of the form 

yo[n] = x[n], (6.31a) 

w k [n] = ai k w k [n - 1] + a lk w k [n - 2] + yk-i[n], k = 1, 2, . . . , N s , (6.31b) 
yk[n] = b kWk[n] + b lk w k [n - 1] + b 2k w k [n - 2], £=1,2,..., N s , (6.31c) 

>M = m[4 ( 6 - 31d ) 

It is easy to see that a variety of theoretically equivalent systems can be obtained 
by simply pairing the poles and zeros in different ways and by ordering the second-order 
sections in different ways. Indeed, if there are N s second-order sections, there are N s ! 
(N s factorial) pairings of the poles with zeros and N s ! orderings of the resulting second- 
order sections, or a total of (N s \) 2 different pairings and orderings. Although these all 
have the same overall system function and corresponding input-output relation when 
infinite-precision arithmetic is used, their behavior with finite-precision arithmetic can 
be quite different, as we will see in Section 6.8. 
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Example 6.5 Illustration of Cascade Structures 

Let us again consider the system function of Eq. (6.28). Since this is a second-order 
system, a cascade structure with direct form II second-order sections reduces to the 
structure of Figure 6.17. Alternatively, to illustrate the cascade structure, we can use 
first-order systems by expressing H(z) as a product of first-order factors, as in 



H{z) = 



l+2z- 1 +z~ 2 



(l+z^Xl + z- 1 ) 



(6.32) 



1 -0.75Z- 1 +0.125z- 2 (1 -0.5^- 1 )(l -0.25Z- 1 )' 

Since all of the poles and zeros are real, a cascade structure with first-order sections has 
real coefficients. If the poles and/or zeros were complex, only a second-order section 
would have real coefficients. Figure 6.19 shows two equivalent cascade structures, each 
of which has the system function in Eq. (6.32). The difference equations represented 
by the flow graphs in the figure can be written down easily. Problem 6.22 is concerned 
with finding other, equivalent system configurations. 



O *■ O * O * Q *• O * Q- 




x[n] 




0.5 



* -l -i 

1z z 




(a) 



0.25 



O »» p * ■ Q > O *■ Q *■ O *■ Q » O 



x[n] 





y[n] 



0.25 



(b) 

Figure 6.19 Cascade structures for Example 6.5. (a) Direct form I subsections, 
(b) Direct form II subsections. 

A final comment should be made about our definition of the system function for 
the cascade form. As defined in Eq. (6.30), each second-order section has five constant 
multipliers. For comparison, let us assume that M = Nin H(z) as given by Eq. (6.27), and 
furthermore, assume that N is an even integer, so that N s = N/2. Then the direct form 
I and II structures have 2N + 1 constant multipliers, while the cascade form structure 
suggested by Eq. (6.30) has 5N/2 constant multipliers. For the sixth-order system in 
Figure 6.18, we require a total of 15 multipliers, while the equivalent direct forms would 
require a total of 13 multipliers. Another definition of the cascade form is 



k=l 



a\kZ' 1 -a 2 kZ- 2 ' 



(6.33) 



where bo is the leading coefficient in the numerator polynomial of Eq. (6.27) and 
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but = bik/bok for / = 1,2 and k = 1, 2, . . . , N s . This form for H(z) suggests a cascade 
of four-multiplier second-order sections, with a single overall gain constant b$. This 
cascade form has the same number of constant multipliers as the direct form structures. 
As discussed in Section 6.8, the five-multiplier second-order sections are commonly 
used when implemented with fixed-point arithmetic, because they make it possible to 
distribute the gain of the system and thereby control the size of signals at various critical 
points in the system. When floating-point arithmetic is used and dynamic range is not a 
problem, the four-multiplier second-order sections can be used to decrease the amount 
of computation. Further simplification results for zeros on the unit circle. In this case, 
b 2 k = 1, and we require only three multipliers per second-order section. 

6.3.3 Parallel Form 

As an alternative to factoring the numerator and denominator polynomials of H(z), 
we can express a rational system function as given by Eq. (6.27) or (6.29) as a partial 
fraction expansion in the form 



Jt=0 Jt=l 



c ^ _l £?(i-4z-')(i -<£*-')' 



where N = N\ + 2N 2 . If M > N, then N p = M — N; otherwise, the first summation 
in Eq. (6.34) is not included. If the coefficients a k and bk are real in Eq. (6.27), then 
the quantities A k , Bk, C*, c k , and e k are all real. In this form, the system function 
can be interpreted as representing a parallel combination of first- and second-order 
IIR systems, with possibly N p simple scaled delay paths. Alternatively, we may group 
the real poles in pairs, so that H(z) can be expressed as 

H(z) = £ C k z- k + £ , eW+ T Z " _ 2 , (635) 

*~^ ^^^ 1 — Q\kZ — QjkZ 

Jt=0 Jt=l lk Zk 

where, as in the cascade form, N s = [(N + 1)/2J is the largest integer contained in 
(A^+ 1)/2, and if N p = M— Nis negative, the first sum is not present. A typical example 
for N = M = 6 is shown in Figure 6.20. The general difference equations for the parallel 
form with second-order direct form II sections are 

w k [n] = ai k w k [n - 1] + a 2 kWk[n - 2] + x[n], k=l,2 ,N S , (636a) 

yk[n] = eQ k w k [n] + ei k Wk[n-l] t k = 1, 2, . . . , N s , (6.36b) 

yW = Yl CkX ^ n ~ fc J + Yl ^*W- (6.36c) 

k=Q fc=l 

If M < N, then the first summation in Eq. (6.36c) is not included. 
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Figure 6.20 Parallel-form structure for sixth-order system {M = /V = 6) with 
the real and complex poles grouped in pairs. 



Example 6.6 Illustration of Parallel-Form Structures 

Consider again the system function used in Examples 6.4 and 6.5. For the parallel 
form, we must express H(z) in the form of either Eq. (6.34) or Eq. (6.35). If we use 
second-order sections, 

" {z) ~ l-0.75z-'+0.125r-2 _ 8 + 1-0.75*-' +0.125*^ " (6 " 37) 

The parallel-form realization for this example with a second-order section is shown in 
Figure 6.21. 

Since all the poles are real, we can obtain an alternative parallel form realization 
by expanding H(z) as 



H(z) = 8 + 



18 



25 



1 - 0.5Z- 1 1 - 0.25Z- 1 * 



(6.38) 



The resulting parallel form with first-order sections is shown in Figure 6.22. As in the 
general case, the difference equations represented by both Figures 6.21 and 6.22 can 
be written down by inspection. 
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Figure 6.21 Parallel-form structure for Example 6.6 using a second-order 
system. 
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Figure 6.22 Parallel-form structure for Example 6.6 using first-order systems. 



6.3.4 Feedback in IIR Systems 

All the flow graphs of this section have feedback loops; i.e., they have closed paths that 
begin at a node and return to that node by traversing branches only in the direction of 
their arrowheads. Such a structure in the flow graph implies that a node variable in a loop 
depends directly or indirectly on itself. A simple example is shown in Figure 6.23(a), 
which represents the difference equation 

y[n]=ay[n-l]+x[n]. (6.39) 

Such loops are necessary (but not sufficient) to generate infinitely long impulse 
responses. This can be seen if we consider a network with no feedback loops. In such a 
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(a) 




(b) 



x[n] 




y[n] 



a 

(c) 



Figure 6.23 (a) System with feedback 
loop, (b) FIR system with feedback loop, 
(c) Noncomputable system. 



case, any path from the input to the output can pass through each delay element only 
once. Therefore, the longest delay between the input and output would occur for a path 
that passes through all of the delay elements in the network. Thus, for a network with 
no loops, the impulse response is no longer than the total number of delay elements in 
the network. From this, we conclude that if a network has no loops, then the system 
function has only zeros (except for poles at z = 0), and the number of zeros can be no 
more than the number of delay elements in the network. 

Returning to the simple example of Figure 6.23(a), we see that when the input is 
the impulse sequence, the single-input sample continually recirculates in the feedback 
loop with either increasing (if \a\ > 1) or decreasing (if \a\ < 1) amplitude due to 
multiplication by the constant a, so that the impulse response is h[n] = a n u[n]. This is 
the way that feedback can create an infinitely long impulse response. 

If a system function has poles, a corresponding block diagram or signal flow graph 
will have feedback loops. On the other hand, neither poles in the system function nor 
loops in the network are sufficient for the impulse response to be infinitely long. Fig- 
ure 6.23(b) shows a network with a loop, but with an impulse response of finite length. 
This is because the pole of the system function cancels with a zero; i.e., for Figure 6.23(b), 



H(z) = 



-1 



,-v 



l-a 2 z~ z (l-az-'Xl+az' 1 ) 



1 — az 



-l 



1 — az 



-l 



= l + az 



-l 



(6.40) 



The impulse response of this system is h[n] — 8[n] + a8[n — 1]. The system is a simple 
example of a general class of FIR systems called frequency-sampling systems. This class 
of systems is considered in more detail in Problems 6.30 and 6.37. 

Loops in a network pose special problems in implementing the computations 
implied by the network. As we have discussed, it must be possible to compute the 
node variables in a network in sequence such that all necessary values are available 
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when needed. In some cases, there is no way to order the computations so that the 
node variables of a flow graph can be computed in sequence. Such a network is called 
noncomputable (Crochiere and Oppenheim, 1975). A simple noncomputable network 
is shown in Figure 6.23(c). The difference equation for this network is 

y[n] = ay[n] + x[n]. (6.41) 

In this form, we cannot compute y[n] because the right-hand side of the equation 
involves the quantity we wish to compute. The fact that a flow graph is noncomputable 
does not mean the equations represented by the flow graph cannot be solved; indeed, 
the solution to Eq. (6.41) is y[n] = x[n]/(l — a). It simply means that the flow graph 
does not represent a set of difference equations that can be solved successively for 
the node variables. The key to the computability of a flow graph is that all loops must 
contain at least one unit delay element. Thus, in manipulating flow graphs representing 
implementations of linear time -invariant systems, we must be careful not to create delay- 
free loops. Problem 6.28 deals with a system having a delay-free loop. Problem 7.45 
shows how a delay-free loop can be introduced. 

6.4 TRANSPOSED FORMS 

The theory of linear signal flow graphs provides a variety of procedures for transforming 
such graphs into different forms while leaving the overall system function between 
input and output unchanged. One of these procedures, called flow graph reversal or 
transposition, leads to a set of transposed system structures that provide some useful 
alternatives to the structures discussed in the previous section. 

Transposition of a flow graph is accomplished by reversing the directions of all 
branches in the network while keeping the branch transmittances as they were and 
reversing the roles of the input and output so that source nodes become sink nodes and 
vice versa. For single-input, single-output systems, the resulting flow graph has the same 
system function as the original graph if the input and output nodes are interchanged. 
Although we will not formally prove this result here, 2 we will demonstrate that it is 
valid with two examples. 

Example 6.7 Transposed Form for a First-Order System 
with No Zeroes 

The first-order system corresponding to the flow graph in Figure 6.24 has system 
function 

H(z) = r -^. (6.42) 

1 — az l 

To obtain the transposed form for this system, we reverse the directions of all the 
branch arrows, taking the output where the input was and injecting the input where 
the output was. The result is shown in Figure 6.25. It is usually convenient to draw the 
transposed network with the input on the left and the output on the right, as shown in 
Figure 6.26. Comparing Figures 6.24 and 6.26 we note that the only difference is that 
in Figure 6.24 we multiply the delayed output sequence y[n — 1] by the coefficient a, 

2 The theorem follows directly from Mason's gain formula of signal flow graph theory. (See Mason and 
Zimmermann, 1960; Chow and Cassignol, 1962; or Phillips and Nagle, 1995.) 
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Figure 6.24 Flow graph of simple first-order system. 
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Figure 6.25 Transposed form of Figure 6.24. 
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Figure 6.26 Structure of Figure 6.25 redrawn with input on left. 

whereas in Figure 6.26 we multiply the output y[n] by the coefficient a and then delay 
the resulting product. Since the two operations can be interchanged, we can conclude 
by inspection that the original system in Figure 6.24 and the corresponding transposed 
system in Figure 6.26 have the same system function. 

In Example 6.7, it is straightforward to see that the original system and its transpose 
have the same system function. However, for more complicated graphs, the result is 
often not so obvious. This is illustrated by the next example. 



Example 6.8 Transposed Form for a Basic 
Second-Order Section 

Consider the basic second-order section depicted in Figure 6.27. The corresponding 
difference equations for this system are 



w[n] = a\w[n — 1] + a2w[n — 2] + x[n], 
y[n] = 6qw[«] + b\w[n — 1] 4- biw[n — 2]. 



(6.43a) 
(6.43b) 



The transposed flow graph is shown in Figure 6.28; its corresponding difference equa- 
tions are 



vo[n] = b x[n\ + vi[n - 1], 
y[n] = v [n], 

vi[n] = aiy[n] + bix[n] + v 2 [n - 1], 
v 2 [n] = a 2 y[n] + b 2 x[n]. 



(6.44a) 
(6.44b) 
(6.44c) 
(6.44d) 



Equations (6.43a)-(6.43b) and Eqs. (6.44a)-(6.44d) are different ways to orga- 
nize the computation of the output samples y[n] from the input samples x[n], and 
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Figure 6.27 Direct form II structure for Example 6.8. 
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Figure 6.28 Transposed direct form II structure for Example 6.8. 

it is not immediately clear that the two sets of difference equations are equivalent. 
One way to show this equivalence is to use the z-transform representations of both 
sets of equations, solve for the ratio Y(z)/ X(z) = H(z) in both cases, and compare the 
results. Another way is to substitute Eq. (6.44d) into Eq. (6.44c), substitute the result 
into Eq. (6.44a), and finally, substitute that result into Eq. (6.44b). The final result is 

y[n] = aiy[n - 1] + a 2 y[n - 2] + b x[n] + bix[n - 1] + b 2 x[n - 2]. (6.45) 

Since the network of Figure 6.27 is a direct form II structure, it is easily seen that 
the input and output of the system in Figure 6.27 also satisfies the difference equa- 
tion (6.45). Therefore, for initial-rest conditions, the systems in Figures 6.27 and 6.28 
are equivalent. 

The transposition theorem can be applied to any of the structures that we have 
discussed so far. For example, the result of applying the theorem to the direct form I 
structure of Figure 6.14 is shown in Figure 6.29, and similarly, the structure obtained by 
transposing the direct form II structure of Figure 6.15 is shown in Figure 6.30. Clearly, 
if a signal flow graph configuration is transposed, the number of delay branches and the 
number of coefficients remain the same. Thus, the transposed direct form II structure 
is also a canonic structure. 

An important point becomes evident through a comparison of Figures 6.15 and 
6.30. Whereas the direct form II structure implements the poles first and then the 
zeros, the transposed direct form II structure implements the zeros first and then the 
poles. These differences can become important in the presence of quantization in finite- 
precision digital implementations or in the presence of noise in discrete-time analog 
implementations. 

When the transposition theorem is applied to cascade or parallel structures, the 
individual second-order systems are replaced by transposed structures. For example, 
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Figure 6.29 General flow graph resulting from applying the transposition theorem 
to the direct form I structure of Figure 6.14. 
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Figure 6.30 General flow graph 
resulting from applying the transposition 
theorem to the direct form II structure of 
Figure 6.15. 

applying the transposition theorem to Figure 6.18 results in a cascade of three transposed 
direct form II sections (like the one in Example 6.8) with the same coefficients as in 
Figure 6.18, but with the order of the cascade reversed. A similar statement can be made 
about the transposition of Figure 6.20. 

The transposition theorem further emphasizes that an infinite variety of imple- 
mentation structures exists for any given rational system function. The transposition 
theorem provides a simple procedure for generating new structures. The problems of 
implementing systems with finite-precision arithmetic have motivated the development 
of many more classes of equivalent structures than we can discuss here. Thus, we con- 
centrate only on the most commonly used structures. 

6.5 BASIC NETWORK STRUCTURES FOR FIR SYSTEMS 



The direct, cascade, and parallel-form structures discussed in Sections 6.3 and 6.4 are 
the most common basic structures for IIR systems. These structures were developed 
under the assumption that the system function had both poles and zeros. Although the 
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Figure 6.31 Direct-form realization of an FIR system. 




Figure 6.32 Transposition of the network of Figure 6.31 . 

direct and cascade forms for IIR systems include FIR systems as a special case, there 
are additional specific forms for FIR systems. 

6.5.1 Direct Form 

For causal FIR systems, the system function has only zeros (except for poles at z = 0), 
and since the coefficients a k are all zero, the difference equation of Eq. (6.9) reduces to 



M 



y\ n \ = ^b k x[n-k\ 



(6.46) 



k=0 



This can be recognized as the discrete convolution of x[n] with the impulse response 

b n /i = 0, 1,...,M, 



h[n] = 



otherwise. 



(6.47) 



In this case, the direct form I and direct form II structures in Figures 6.14 and 6.15 both 
reduce to the direct-form FIR structure shown in Figure 6.31. Because of the chain of 
delay elements across the top of the diagram, this structure is also referred to as a tapped 
delay line structure or a transversal filter structure. As seen from Figure 631, the signal 
at each tap along this chain is weighted by the appropriate coefficient (impulse-response 
value), and the resulting products are summed to form the output y[ri\. 

The transposed direct form for the FIR case is obtained by applying the transpo- 
sition theorem to Figure 6.31 or, equivalently, by setting the coefficients a k to zero in 
Figure 6.29 or Figure 6.30. The result is shown in Figure 6.32. 

6.5.2 Cascade Form 

The cascade form for FIR systems is obtained by factoring the polynomial system 
function. That is, we represent H(z) as 

M Ms 

H(z) = Y, h Wz~ n = n^°* + b ^ z ~ l + b2kZ ~ 2 ^ < 6 - 48 ) 

*=o k=l 
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Figure 6.33 Cascade-form realization of an FIR system. 

where M s — |_(M+ 1)/2J is the largest integer contained in (Af + 1)/2. If Mis odd, one 
of the coefficients 62* will be zero, since H(z) in that case would have an odd number 
of real zeros. The flow graph representing Eq. (6.48) is shown in Figure 6.33, which is 
identical in form to Figure 6.18 with the coefficients a\k and aik all zero. Each of the 
second-order sections in Figure 6.33 uses the direct form shown in Figure 6.31. Another 
alternative is to use transposed direct-form second-order sections or, equivalently, to 
apply the transposition theorem to Figure 6.33. 



6.5.3 Structures for Linear-Phase FIR Systems 

In Chapter 5, we showed that causal FIR systems have generalized linear phase if the 
impulse response satisfies the symmetry condition 



or 



h[M-n] = h[n] n = 0, 1,...,M 



h[M -n] = -h[n] n = 0, 1, . . . , M. 



(6.49a) 



(6.49b) 



With either of these conditions, the number of coefficient multipliers can be essen- 
tially halved. To see this, consider the following manipulations of the discrete convolu- 
tion equation, assuming that M is an even integer corresponding to type I or type III 
systems: 

M 



*=0 

Af/2-1 



M 



= Y, h[k\x[n -k\+ h[M/2]x[n - M/2] + £ M*M« ~ *] 

k=Q k=M/2+l 

M/2-1 Af/2-1 

= ^ h[k]x[n -k] + h[M/2]x[n - M/2] + ^ h[M - k]x[n -M + k]. 

k=0 *=0 

For type I systems, we use Eq. (6.49a) to obtain 
M/2-1 
y[n] = Y, h W(x[n - k] + x[n - M + k]) + h[M/2]x[n - M/2]. (6.50) 

k=0 
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For type III systems, we use Eq. (6.49b) to obtain 

M/2-1 

y[n] = Y, h[k](x[n - k] - x[n - M + A:]). 



(6.51) 



Jt=0 



For the case of M an odd integer, the corresponding equations are, for type II systems, 

(M-l)/2 

y[n]= Y, h[k](x[n - k] + x[n - M + k]) (6.52) 



A:=0 



and, for type IV systems, 



(M-l)/2 

y [n]= Yl h[k](x[n-k]-x[n-M + k]). 

k=0 



(6.53) 



Equations (6.50)-(6.53) imply structures with either M/2 + 1, A//2, or (M + l)/2 
coefficient multipliers, rather than the M coefficient multipliers of the general direct- 
form structure of Figure 6.31. Figure 6.34 shows the structure implied by Eq. (6.50), and 
Figure 6.35 shows the structure implied by Eq. (6.52). 

In our discussion of linear-phase systems in Section 5.7.3, we showed that the 
symmetry conditions of Eqs. (6.49a) and (6.49b) cause the zeros of H(z) to occur in 
mirror-image pairs. That is, if zo is a zero of H(z), then 1/zo is also a zero of H(z). 
Furthermore, if h[n] is real, then the zeros of H(z) occur in complex-conjugate pairs. 




Figure 6.34 Direct-form structure for an FIR linear-phase system when M is 
an even integer. 




Figure 6.35 Direct-form structure for an FIR linear-phase system when M is an 
odd integer. 
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Figure 6.36 Symmetry of zeros for a 
linear-phase FIR filter. 



As a consequence, real zeros not on the unit circle occur in reciprocal pairs. Complex 
zeros not on the unit circle occur in groups of four, corresponding to the complex con- 
jugates and reciprocals. If a zero is on the unit circle, its reciprocal is also its conjugate. 
Consequently, complex zeros on the unit circle are conveniently grouped into pairs. 
Zeros at z = ±1 are their own reciprocal and complex conjugate. The four cases are 
summarized in Figure 6.36, where the zeros at zi, zj, 1/zi, and 1/zJ are considered as a 
group of four. The zeros at zi and \jzi are considered as a group of two, as are the zeros 
at Z3 and z\ . The zero at za is considered singly. If H(z) has the zeros shown in Figure 6.36, 
it can be factored into a product of first-, second-, and fourth-order factors. Each of these 
factors is a polynomial whose coefficients have the same symmetry as the coefficients 
of H(z)\ i.e., each factor is a linear-phase polynomial in z _1 . Therefore, the system can 
be implemented as a cascade of first-, second-, and fourth-order systems. For example, 
the system function corresponding to the zeros of Figure 6.36 can be expressed as 



H(z) = h[0](l + z- ! )(l + az~ l + z" 2 )(l + bz~ l + z~ 2 ) 
x (1 + cz~ x + dz' 2 + cz~ 3 + z -4 ), 



(6.54) 



where 



a = (z 2 + l/z 2 ), b = ITleizs}, c = -2Tle{zi + 1/zi}, d = 2 + |zi + 1/zi | 2 . 

This representation suggests a cascade structure consisting of linear-phase elements. It 
can be seen that the order of the system function polynomial is M = 9 and the number 
of different coefficient multipliers is five. This is the same number ((M+ l)/2 = 5) 
of constant multipliers required for implementing the system in the linear-phase di- 
rect form of Figure 6.34. Thus, with no additional multiplications, we obtain a modular 
structure in terms of a cascade of short linear-phase FIR systems. 



6.6 OVERVIEW OF FINITE-PRECISION NUMERICAL EFFECTS 



We have seen that a particular linear time-invariant discrete-time system can be im- 
plemented by a variety of computational structures. One motivation for considering 
alternatives to the simple direct-form structures is that different structures that are the- 
oretically equivalent may behave differently when implemented with finite numerical 
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precision. In this section, we give a brief introduction to the major numerical problems 
that arise in implementing discrete-time systems. A more detailed analysis of these 
finite-word-length effects is given in Sections 6.7-6.9. 

6.6. 1 Number Representations 

In theoretical analyses of discrete-time systems, we generally assume that signal values 
and system coefficients are represented in the real-number system. However, with ana- 
log discrete-time systems, the limited precision of the components of a circuit makes 
it difficult to realize coefficients exactly. Similarly, when implementing digital signal- 
processing systems, we must represent signals and coefficients in some digital number 
system that must always be of finite precision. Most general-purpose digital computers, 
DSP chips, or special-purpose hardware use a binary number system. 

The problem of finite numerical precision has already been discussed in Sec- 
tion 4.8.2 in the context of A/D conversion. We showed there that the output samples 
from an A/D converter are quantized and thus can be represented by fixed-point binary 
numbers. For compactness and simplicity in implementing arithmetic, one of the bits 
of the binary number is assumed to indicate the algebraic sign of the number. Formats 
such as sign and magnitude, one's complement, and two's complement are possible, but 
two's complement is most common. 3 A real number can be represented with infinite 
precision in two's-complement form as 

x = X m (-b Q + jr t b i 2- i Y (6.55) 

where X m is an arbitrary scale factor and the /),'s are either or 1. The quantity bo is 
referred to as the sign bit. If bo = 0, then < x < X m , and if bo = 1, then — X m < x < 0. 
Thus, any real number whose magnitude is less than or equal to X m can be represented 
by Eq. (6.55). An arbitrary real number x would require an infinite number of bits for 
its exact binary representation. As we saw in the case of A/D conversion, if we use only 
a finite number of bits (B + 1 ), then the representation of Eq. (6.55) must be modified 
to 

x = Q B [x] = X m (-b + Y^ bi2 ~ l ) = Xm * B - < 6 - 56 ) 

The resulting binary representation is quantized, so that the smallest difference between 
numbers is 

A = X m 2' B . (6.57) 

In this case, the quantized numbers are in the range — X m < x < X m . The fractional 
part of x can be represented with the positional notation 

xb = ^oo^i^2^3 • • • b B , (6.58) 

where o represents the binary point. 

3 A detailed description of binary number systems and corresponding arithmetic is given by Knuth 

(1997). 
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Figure 6.37 Nonlinear relationships 
representing two's-complement 
(a) rounding and (b) truncation 
for = 2. 



The operation of quantizing a number to (B + 1) bits can be implemented by 
rounding or by truncation, but in either case quantization is a nonlinear memory- 
less operation. Figures 6.37(a) and 6.37(b) show the input-output relation for two's- 
complement rounding and truncation, respectively, for the case B = 2. In considering 
the effects of quantization, we often define the quantization error as 



e = Qb[x] - x. 

For the case of two's-complement rounding, — A/2 
complement truncation, —A < e < 0. 4 



< 



(6.59) 
e < A/2, and for two's- 



4 Note that Eq. (6.56) also represents the result of rounding or truncating any (Si + l)-bit binary 
representation, where B\ > B. In this case A would be replaced by (A — X m 2~ Bi ) in the bounds on the size 
of the quantization error. 
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If a number is larger than X m (a situation called an overflow), we must implement 
some method of determining the quantized result. In the two's-complement arithmetic 
system, this need arises when we add two numbers whose sum is greater than X m . For 
example, consider the 4-bit two's-complement number 0111, which in decimal form is 7. 
If we add the number 0001, the carry propagates all the way to the sign bit, so that the re- 
sult is 1000, which in decimal form is —8. Thus, the resulting error can be very large when 
overflow occurs. Figure 6.38(a) shows the two's-complement quantizer, including the 
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Figure 6.38 Two's-complement rounding, (a) Natural overflow, (b) Saturation. 



374 Structures for Discrete-Time Systems Chap. 6 

effect of regular two's-complement arithmetic overflow. An alternative, which is called 
saturation overflow or clipping, is shown in^igure 6.38(b). This method of handling over- 
flow is generally implemented for A/D conversion, and it sometimes is implemented in 
specialized DSP microprocessors for the addition of two's-complement numbers. With 
saturation overflow, the size of the error does not increase abruptly when overflow 
occurs; however, a disadvantage of the method is that it voids the following interest- 
ing and useful property of two's-complement arithmetic: If several two's-complement 
numbers whose sum would not overflow are added, then the result of two's-complement 
accumulation of these numbers is correct, even though intermediate sums might over- 
flow. 

Both quantization and overflow introduce errors in digital representations of num- 
bers. Unfortunately, to minimize overflow while keeping the number of bits the same, 
we must increase X m and thus increase the size of quantization errors proportionately. 
Hence, to simultaneously achieve wider dynamic range and lower quantization error, 
we must increase the number of bits in the binary representation. 

So far, we have simply stated that the quantity X m is an arbitrary scale factor; 
however, this factor has several useful interpretations. In A/D conversion, we considered 
X m to be the full-scale amplitude of the A/D converter. In this case, X m would probably 
represent a voltage or current in the analog part of the system. Thus, X m serves as a 
calibration constant for relating binary numbers in the range — 1 < xb < 1 to analog 
signal amplitudes. 

In digital signal-processing implementations, it is common to assume that all signal 
variables and all coefficients are binary fractions. Thus, if we multiply a (B+ l)-bit signal 
variable by a (B + l)-bit coefficient, the result is a (25 + l)-bit fraction that can be 
conveniently reduced to (B + 1) bits by rounding or truncating the least significant bits. 
With this convention, the quantity X m can be thought of as a scale factor that allows the 
representation of numbers that are greater than unity in magnitude. For example, in 
fixed-point computations, it is common to assume that each binary number has a scale 
factor of the form X m = 2 C . Accordingly, a value c = 2 implies that the binary point is 
actually located between b^ and b?, of the binary word in Eq. (6.58). Often, this scale 
factor is not explicitly represented; instead, it is implicit in the implementation program 
or hardware architecture. 

Still another way of thinking about the scale factor X m leads to the floating-point 
representations, in which the exponent c of the scale factor is called the characteristic 
and the fractional part xb is called the mantissa. The characteristic and the mantissa 
are each represented explicitly as binary numbers in floating-point arithmetic systems. 
Floating-point representations provide a convenient means for maintaining both a wide 
dynamic range and a small quantization noise; however, quantization error manifests 
itself in a somewhat different way. 

6.6.2 Quantization in Implementing Systems 

Numerical quantization affects the implementation of linear time-invariant discrete- 
time systems in several ways. As a simple illustration, consider Figure 6.39(a), which 
shows a block diagram for a system in which a bandlimited continuous-time signal x c (t) 
is sampled to obtain the sequence x[n] y which is the input to a linear time-invariant 
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Figure 6.39 Implementation of discrete-time filtering of an analog signal, 
(a) Ideal system, (b) Nonlinear model, (c) Linearized model. 



system whose system function is 



H(z) = 



1 - az 



-l 



(6.60) 



The output of this system, y[n], is converted by ideal bandlimited interpolation to the 
bandlimited signal y c (t). 

A more realistic model is shown in Figure 6.39(b). In a practical setting, sampling 
would be done with an A/D converter with finite precision of (5, + 1) bits. The sys- 
tem would be implemented with binary arithmetic of (B + 1) bits. The coefficient a in 
Figure 6.39(a) would be represented with (5+1) bits of precision. Also, the delayed 
variable v[n — 1] would be stored in a (B + l)-bit register, and when the (B + l)-bit 
number v[n — 1] is multiplied by the (B + l)-bit number a, the resulting product would 
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be {IB + 1) bits in length. If we assume that a (B + l)-bit adder is used, the product 
av\n — 1] must be quantized^i.e., rounded or truncated) to (B + 1) bits before it can 
be added to the (fi ( - + l)-bit input sample x[n]. When 5, < B, the {B t + 1) bits of the 
input samples can be placed anywhere in the (B + l)-bit binary word with appropriate 
extension of the sign. Different choices correspond to different scalings of the input. 
The coefficient a has been quantized, so leaving aside the other quantization errors, 
the system response cannot in general be the same as in Figure 6.39(a). Finally, the 
(B + l)-bit samples v[/i], computed by iterating the difference equation represented 
by the block diagram, would be converted to an analog signal by a (B + l)-bit D/A 
converter. When B < B, the output samples must be quantized before D/A conver- 
sion. 

Although the model of Figure 6.39(b) could be an accurate representation of a real 
system, it would be difficult to analyze. The system is nonlinear due to the quantizers 
and the possibility of overflow at the adder. Also, quantization errors are introduced 
at many points in the system. The effects of these errors are impossible to analyze 
precisely, since they depend on the input signal, which we generally consider to be 
unknown. Thus, we are forced to adopt several different approximation approaches to 
simplify the analysis of such systems. 

The effect of quantizing the system parameters, such as the coefficient a in Fig- 
ure 6.39(a), is generally determined separately from the effect of quantization in data 
conversion or in implementing difference equations. That is, the ideal coefficients of a 
system function are replaced by their quantized values, and the resulting response func- 
tions are tested to see whether quantization has degraded the performance of the system 
to unacceptable levels. For the example of Figure 6.39, if the real number a is quantized 
to (B + 1) bits, we must consider whether the resulting system with system function 

is close enough to the desired system function H(z) given by Eq. (6.60). Since there 
are only 2 B+1 different (B + l)-bit binary numbers, the pole of H(z) can occur only at 
2 B+1 locations on the real axis of the z-plane. This type of analysis is discussed in more 
general terms in Section 6.7. 

The nonlinearity of the system of Figure 6.39(b) causes behavior that cannot occur 
in a linear system. Specifically, systems such as this can exhibit zero-input limit cycles, 
whereby the output oscillates periodically when the input becomes zero after having 
been non-zero. Limit cycles are caused both by quantization and by overflow. Although 
the analysis of such phenomena is difficult, some useful approximate results have been 
developed. Limit cycles are discussed briefly in Section 6.9. 

If care is taken in the design of a digital implementation, we can ensure that 
overflow occurs only rarely and quantization errors are small. Under these conditions, 
the system of Figure 6.39(b) behaves very much like a linear system (with quantized 
coefficients) in which quantization errors are injected at the input and output and at 
internal points in the network where rounding or truncation occurs. Therefore, we can 
replace the model of Figure 6.39(b) by the linearized model of Figure 6.39(c), where 
the quantizers are replaced by additive noise sources (Gold and Rader, 1969; Jackson, 
1970a, 1970b). Figure 6.39(c) is equivalent to Figure 6.39(b) if we know each of the 
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noise sources exactly. However, as discussed in Section 4.8.3, useful results are obtained 
if we assume a random noise model for the quantization noise in A/D conversion. 
This same approach can be used in analyzing the effects of arithmetic quantization in 
digital implementations of linear systems. As seen in Figure 6.39(c), each noise source 
injects a random signal that is processed by a different part of the system, but since 
we assume that all parts of the system are linear, we can compute the overall effect by 
superposition. In Section 6.8, we illustrate this style of analysis for several important 
systems. 

In the simple example of Figure 6.39, there is little flexibility in the choice of 
structure. However, for higher order systems, we have seen that there is a wide variety 
of choices. Some of the structures are less sensitive to coefficient quantization than 
others. Similarly, because different structures have different quantization noise sources 
and because these noise sources are filtered in different ways by the system, we will find 
that structures which are theoretically equivalent sometimes perform quite differently 
when finite-precision arithmetic is used to implement them. 



6.7 THE EFFECTS OF COEFFICIENT QUANTIZATION 

Linear time-invariant discrete-time systems are generally used to perform a filtering 
operation. Methods for designing FIR and IIR filters are discussed in Chapter 7. These 
design methods typically assume a particular form for the system function. The result 
of the filter design process is a system function for which we must choose an imple- 
mentation structure (a set of difference equations) from infinitely many theoretically 
equivalent implementations. Although we are almost always interested in implemen- 
tations that require the least hardware or software complexity, it is not always possible 
to base the choice of implementation structure on this criterion alone. As we will see in 
Section 6.8, the implementation structure determines the quantization noise generated 
internally in the system. Also, some structures are more sensitive than others to pertur- 
bations of the coefficients. As we pointed out in Section 6.6, the standard approach to 
the study of these issues is to treat them independently. In this section, we consider the 
effects of quantizing the system parameters. 



6.7.1 Effects of Coefficient Quantization in IIR Systems 

When the parameters of a rational system function or corresponding difference equation 
are quantized, the poles and zeros of the system function move to new positions in the 
z-plane. Equivalently, the frequency response is perturbed from its original value. If the 
system implementation structure is highly sensitive to perturbations of the coefficients, 
the resulting system may no longer meet the original design specifications, or an IIR sys- 
tem might even become unstable. 

A detailed sensitivity analysis for the general case is complex and usually of limited 
value in specific cases of digital filter implementation. Using powerful simulation tools, it 
is usually easiest to simply quantize the coefficients of the difference equations employed 
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in implementing the system and then compute the frequency response and compare it 
with the desired frequency-response function. Even though simulation of the system is 
generally necessary in specific cases, it is still worthwhile to consider, in general, how the 
system function is affected by quantization of the coefficients of the difference equations. 
For example, the system function representation corresponding to both direct forms is 
the ratio of polynomials 

M 

.-k 



5>* 



H(z) = -^2_ . (6.62) 



i-E 



<*kZ k 



The sets of coefficients {<?*} and {£>*} are the ideal infinite -precision coefficients in both 
direct-form implementation structures. If we quantize these coefficients, we obtain the 
system function 

M 

H(z) = -^ , (6.63) 



i-£ a * z " 



-k 
"k* 

k=l 



where a/c = cik + Aa* arid fe* = bk + A6* are the quantized coefficients that differ from 
the original coefficients by the quantization errors Aa* and A 6*. 

Now consider how the roots of the denominator and numerator polynomials (the 
poles and zeros of H(z)) are affected by the errors in the coefficients. Clearly, each 
polynomial root is affected by all of the errors in the coefficients of the polynomial. 
Thus, each pole and zero will be affected by all of the quantization errors in the de- 
nominator and numerator polynomials, respectively. More specifically, Kaiser (1966) 
showed that if the poles (or zeros) are tightly clustered, it is possible that small errors in 
the denominator (numerator) coefficients can cause large shifts of the poles (zeros) for 
the direct-form structures. Thus, if the poles (zeros) are tightly clustered, corresponding 
to a narrow-bandpass filter or a narrow-bandwidth lowpass filter, then we can expect 
the poles of the direct-form structure to be quite sensitive to quantization errors in 
the coefficients. Furthermore, Kaiser's analysis showed that the larger the number of 
clustered poles (zeros), the greater is the sensitivity. 

The cascade- and parallel-form system functions, which are given by Eqs. (6.30) 
and (6.35), respectively, consist of combinations of second-order direct-form systems. 
However, in both cases, each pair of complex-conjugate poles is realized independently 
of all the other poles. Thus, the error in a particular pole pair is independent of its 
distance from the other poles of the system function. For the cascade form, the same 
argument holds for the zeros, since they are realized as independent second-order fac- 
tors. Thus, the cascade form is generally much less sensitive to coefficient quantization 
than the equivalent direct-form realization. 

As seen in Eq. (6.35), the zeros of the parallel-form system function are realized 
implicitly, through combining the quantized second-order sections to obtain a common 
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denominator. Thus, a particular zero is affected by quantization errors in the numerator 
and denominator coefficients of all the second-order sections. However, for most prac- 
tical filter designs, the parallel form is also found to be much less sensitive to coefficient 
quantization than the equivalent direct forms because the second-order subsystems are 
not extremely sensitive to quantization. In many practical filters, the zeros are often 
widely distributed around the unit circle, or in some cases they may all be located at 
z = ±1. In the latter situation, the zeros mainly provide much higher attenuation around 
frequencies a> = and a> = n than is specified, and thus, movements of zeros away from 
z = ±1 do not significantly degrade the performance of the system. 

6.7.2 Example of Coefficient Quantization in 
an Elliptic Filter 

To illustrate the effect of coefficient quantization, consider the example of a bandpass 
IIR elliptic filter. The filter was designed to meet the following specifications: 

0.99 < \H(e^)\ < 1.01, 0.3jt < M < OAtt, 

\H(e> a )\ < 0.01(i.e., - 40dB), \o>\ < 0.29tt, 

\H(e^)\ < 0.01(i.e., - 40dB), 0.41;r < M < jr. 

A filter of order 12 is required to meet these sharp-cutoff narrowband specifications. 

In the filter design process, the coefficients of the cascade form were computed 
with 32-bit floating-point accuracy. These are coefficients defined as "unquantized." 
Table 6.1 gives the coefficients of the six second-order sections (as defined in Eq. (6.30)). 
Figure 6.40(a) shows the log magnitude in dB, and Figure 6.40(b) shows the magnitude 
response in the passband (i.e., 0.3;r < |a>| < 0.4;r) for the unquantized system. 

To illustrate how coefficients are quantized and represented as fixed-point num- 
bers, the coefficients in Table 6.1 were quantized to 16-bit accuracy. The resulting coef- 
ficients are presented in Table 6.2. The fixed-point coefficients are shown as a decimal 
integer times a power-of-2 scale factor. The binary representation would be obtained 
by converting the decimal integer to a binary number. In a fixed-point implementation, 
the scale factor would be represented only implicitly in the data shifts that would be 
necessary to line up the binary points of products prior to their addition to other prod- 
ucts. Notice that binary points of the coefficients are not all in the same location. For 
example, all the coefficients with scale factor 2~ 15 have their binary points between the 

TABLE 6.1 UNQUANTIZED CASCADE-FORM COEFFICIENTS 
FOR A 12TH-0RDER ELLIPTIC FILTER 



k 


fll* 


aik 


bok 


b\k 


t>2k 


1 


0.738409 


-0.850835 


0.135843 


0.026265 


0.135843 


2 


0.960374 


-0.860000 


0.278901 


-0.444500 


0.278901 


3 


0.629449 


-0.931460 


0.535773 


-0.249249 


0.535773 


4 


1.116458 


-0.940429 


0.697447 


-0.891543 


0.697447 


5 


0.605182 


-0.983693 


0.773093 


-0.425920 


0.773093 


6 


1.173078 


-0.986166 


0.917937 


-1.122226 


0.917937 
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TABLE 6.2 SIXTEEN-BIT QUANTIZED CASCADE-FORM COEFFICIENTS FOR A 
12TH-0RDER ELLIPTIC FILTER 



k 


a\k 


aik 


^Ofc 


b\k 


bik 


1 


24196 x 2' 15 


-27880 x 2 15 


17805 x 2~ 17 


3443 x 2- 17 


17805 x 2- 17 


2 


31470 x 2~ 15 


-28180 x 2- 15 


18278 x 2 16 


-29131 x 2" 16 


18278 x 2~ 16 


3 


20626 x 2~ 15 


-30522 x 2^ 15 


17556 x 2" 15 


-8167 x2- 15 


17556 x 2- 15 


4 


18292 x 2" 14 


-30816 x 2 15 


22854 x 2~ 15 


-29214 x 2~ 15 


22854 x 2~ 15 


5 


19831 x 2~ 15 


-32234 x 2~ 15 


25333 x 2- 15 


-13957 x 2" 15 


25333 x 2" 15 


6 


19220 x 2 14 


-32315 x 2" 15 


15039 x 2~ u 


-18387 x 2~ 14 


15039 x 2" 14 



sign bit, £>o, and the highest fractional bit, b\, as shown in Eq. (6.58). However, numbers 
whose magnitudes do not exceed 0.5, such as the coefficient btyi, can be shifted left by 
one or more bit positions. 5 Thus, the binary point for b$i is actually to the left of the 

5 The use of different binary point locations retains greater accuracy in the coefficients, but it compli- 
cates the programming or system architecture. 
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sign bit. On the other hand, numbers whose magnitudes exceed 1 but are less than 2, 
such as #i6, must have their binary points moved one position to the right, i.e., between 
b\ and 6 2 in Eq. (6.58). 

Figure 6.40(c) shows the magnitude response in the passband for the quantized 
cascade-form implementation. The frequency response is only slightly degraded in the 
passband region. 

To obtain other equivalent structures, the cascade-form system function must be 
rearranged into a different form. For example, if a parallel-form structure is determined 
(by partial fraction expansion of the unquantized system function), and the resulting 
coefficients are quantized to 16 bits as before, the frequency response in the passband 
is as shown in Figure 6.40(d). 

If the second-order factors in the numerator and denominator of the unquantized 
cascade form are multiplied together to form 12th-order numerator and denominator 
polynomials, and if the resulting coefficients are quantized to 16 bits and used in a 
direct-form structure, the log magnitude of the frequency response is as shown in Fig- 
ure 6.40(e). In this case, the passband response is virtually destroyed by the quantization. 
Comparing Figure 6.40(e) with Figure 6.40(a) shows that the widely separated zeros on 
either side of the passband (at approximately co = 2tt and .54tt) have not moved off the 
unit circle. However, the unquantized system has a pair of zeros on the unit circle just at 
both stopband edges. These zeros, being clustered, move away from the unit circle with 
quantization and thus contribute to the overall degradation of the frequency response. 



6.7.3 Poles of Quantized Second-Order Sections 

The example just discussed illustrates the robustness of the cascade and parallel forms 
to the effects of coefficient quantization, and it also illustrates the extreme sensitivity 
of the direct forms for high-order filters. Because of this sensitivity, the direct forms 
are rarely used for implementing anything other than second-order systems. 6 Since the 
cascade and parallel forms can be configured to require the same amount of memory and 
the same or only slightly more computation as the canonic direct form, these modular 
structures are the most commonly used. More complex structures may be more robust 
for very short word lengths, but they require significantly more computation for systems 
of the same order. 

Even for the second-order systems that are used to implement the cascade and 
parallel forms, there remains some flexibility to improve the robustness to coefficient 
quantization. Consider a complex-conjugate pole pair implemented using the direct 
form, as in Figure 6.41. With infinite-precision coefficients, this network has poles at 
z = re }(> and z = re~' i& . However, if the coefficients 2r cos# and — r 2 are quantized, 
only a finite number of different pole locations is possible. The poles must lie on a grid 
in the z-plane defined by the intersection of concentric circles (corresponding to the 
quantization of r 2 ) and vertical lines (corresponding to the quantization of 2r cos 9). 
Such a grid is illustrated in Figure 6.42(a) for 4-bit quantization (3 bits plus 1 bit for the 
sign); i.e., r 2 is restricted to seven positive values and zero, while 2r cos 9 is restricted to 

6 An exception is in speech synthesis, where systems of 10th order and higher are routinely implemented 
using the direct form. This is possible because in speech synthesis the poles of the system function are widely 
separated (Rabiner and Schafer, 1978). 



Sec. 6.7 The Effects of Coefficient Quantization 



383 



x[n] 



2r cos 6 



V 1 



tZ 



-1 



y[n] 



Figure 6.41 Direct-form 
implementation of a complex-conjugate 
pole pair. 
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Figure 6.42 Pole-locations for the 
second-order IIR direct-form system of 
Figure 6.41. (a) Four-bit quantization of 
coefficients, (b) Seven-bit quantization. 



seven positive values, eight negative values, and zero. Figure 6.42(b) shows a denser grid 
obtained with 7-bit quantization (6 bits plus 1 bit for the sign). The plots of Figure 6.42 
are, of course, symmetrically mirrored into each of the other quadrants of the z-plane. 
Notice that for the direct form, the grid is rather sparse around the real axis. Thus, poles 
located around 6 = or 6 = n may be shifted more than those around 9 = n/2. Of 
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Figure 6.43 Coupled-form 
implementation of a complex-conjugate 
pole pair. 



course, it is always possible that the infinite-precision pole location is very close to one 
of the allowed quantized poles. In this case, quantization causes no problem whatsoever, 
but in general, quantization can be expected to degrade performance. 

An alternative second-order structure for realizing poles at z = re* 9 and z = re~* 6 
is shown in Figure 6.43. This structure is referred to as the coupled form for the second- 
order system (Rader and Gold, 1967). It is easily verified that the systems of Figures 6.41 
and 6.43 have the same poles for infinite-precision coefficients. To implement the system 
of Figure 6.43, we must quantize r cos0 and r sin#. Since these quantities are the real 
and imaginary parts, respectively, of the pole locations, the quantized pole locations 
are at intersections of evenly spaced horizontal and vertical lines in the z-plane. Fig- 
ures 6.44(a) and 6.44(b) show the possible pole locations for 4-bit and 7-bit quantization, 
respectively. In this case, the density of pole locations is uniform throughout the interior 
of the unit circle. Twice as many constant multipliers are required to achieve this more 
uniform density. In some situations, the extra computation might be justified to achieve 
more accurate pole location with reduced word length. 



6.7.4 Effects of Coefficient Quantization in FIR Systems 

For FIR systems, we must be concerned only with the locations of the zeros of the 
system function, since, for causal FIR systems, all the poles are at z = 0. Although we 
have just seen that the direct-form structure should be avoided for high-order IIR sys- 
tems, it turns out that the direct-form structure is commonly used for FIR systems. To 
understand why this is so, we express the system function for a direct-form FIR system 
in the form 



M 



H(z) = J2 h Wz-"- 



(6.64) 



n=0 



Now, suppose that the coefficients {h[n]) are quantized, resulting in a new set of coeffi- 
cients [h[n] = h[n] + A/i[n]}. The system function for the quantized system is then 



M 



H(z) = X^M*"" = H(z) + A//(z), 



(6.65) 



n=0 
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AH(z) = Y, *h[n]z- n . 



(6.66) 



«=o 



Thus, the system function (and therefore, also the frequency response) of the quantized 
system is linearly related to the quantization errors in the impulse-response coefficients. 
For this reason, the quantized system can be represented as in Figure 6.45, which shows 
the unquantized system in parallel with an error system whose impulse response is 
the sequence of quantization error samples {A/i[/i]} and whose system function is the 
corresponding z-transform, AH(z). 

Another approach to studying the sensitivity of the direct-form FIR structure 
would be to examine the sensitivity of the zeros to quantization errors in the impulse- 
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Figure 6.45 Representation of 
coefficient quantization in FIR systems. 



response coefficients, which are, of course the coefficients of the polynomial H(z). If 
the zeros of H(z) are tightly clustered, then their locations will be highly sensitive to 
quantization errors in the impulse-response coefficients. The reason that the direct form 
FIR system is widely used is that, for most linear phase FIR filters, the zeros are more 
or less uniformly spread in the z-plane. We demonstrate this by the following example. 

6.7.5 Example of Quantization of an Optimum FIR Filter 

As an example of the effect of coefficient quantization in the FIR case, consider a 
linear-phase lowpass filter designed to meet the following specifications: 



0.99 < \H(e ja, )\ < 1.01, 
\H{e jw )\ < 0.001(i.e., -60 dB), 



< \co\ < OAtt, 
0.6tt < M < it. 



This filter was designed using the Parks-McClellan design technique, which will be 
discussed in Section 7,4.3. The details of the design for this example are considered in 
Section 7.5.1. 

Table 6.3 shows the unquantized impulse-response coefficients for the system, 
along with quantized coefficients for 16-, 14-, 13-, and 8-bit quantization. Figure 6.46 
gives a comparison of the frequency responses of the various systems. Figure 6.46(a) 
shows the log magnitude in dB of the frequency response for unquantized coefficients. 



TABLE 6.3 UNQUANTIZED AND QUANTIZED COEFFICIENTS FOR AN OPTIMUM FIR 
LOWPASS FILTER {M = 27) 



Coefficient 


Unquantized 


16 bits 




14 bits 




13 bits 




8 bits 


h[Q] = h[27] 


1.359657 x 1(T 3 


45 x 2" 


15 


11 x2 


13 


6x2" 


12 


0x2- 7 


h[l] = h[26] 


-1.616993 x 10 3 


-53 x 2" 


15 


-13 x 2" 


13 


-7x 2~ 


12 


0x2 7 


h[2] = h[25] 


-7.738032 x 10 3 


-254 x 2" 


15 


-63 x 2" 


13 


-32 x 2" 


12 


-1 x 2- 7 


h[3] = h[24] 


-2.686841 x 10~ 3 


-88 x 2" 


15 


-22 x 2' 


13 


-11 x2" 


12 


0x2- 7 


h[4] = h[23] 


1.255246 x 10 2 


411 x2- 


15 


103 x 2" 


13 


51 x2" 


12 


2x 2- 7 


h[5] = h[22] 


6.591530 x 10- 3 


216x2" 


15 


54x2- 


13 


27x2- 


12 


1 x2~ 7 


h[6] = h[21] 


-2.217952 x 10~ 2 


-727 x 2~ 


15 


-182 x 2~ 


13 


-91 x 2" 


2 


-3 x 2~ 7 


h[7] = h[20] 


-1.524663 x 10" 2 


-500 x 2" 


15 


-125 x 2~ 


13 


-62 x 2~ 


12 


-2 x 2" 7 


h[S] = h[l9] 


3.720668 x 10" 2 


1219x2- 


15 


305 x 2" 


13 


152 x 2" 


12 


5x2" 7 


h[9] = h[l8] 


3.233332 x 10" 2 


1059 x 2" 


15 


265 x 2" 


13 


132 x 2~ 


12 


4x 2" 7 


h[10] = h[ll] 


-6.537057 x 10~ 2 


-2142 x 2~ 


15 


-536 x 2~ 


13 


-268 x 2- 


12 


-8 x 2- 7 


h[ll]=h[16] 


-7.528754 x 10" 2 


-2467 x 2~ 


15 


-617 x X- 


13 


-308 x 2" 


12 


-10 x2- 7 


h[12] = h[15] 


1.560970 x 10- 1 


5115x2" 


15 


1279 x 2 


13 


639 x 2- 


12 


20 x 2~ 7 


h[13] = h[U] 


4.394094 x 10" 1 


14399 x 2" 


15 


3600 x 2" 


13 


1800 x 2~ 


12 


56 x 2~ 7 
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Figure 6.46 FIR quantization example. 

(a) Log magnitude for unquantized case. 

(b) Approximation error for unquantized 
case. (Error not defined in transition 
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quantization. 
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(d) Approximation error for 14-bit 
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Figures 6.46(b), (c), (d), (e), and (f) show the passband and stopband approximation 
errors (errors in approximating unity in the passband and zero in the stopband) for 
the unquantized, 16-, 14-, 13-, and 8-bit quantized cases, respectively. From Figure 6.46, 
we see that the system meets the specifications for the unquantized case and both the 
16-bit and 14-bit quantized cases. However, with 13-bit quantization the stopband ap- 
proximation error becomes greater than 0.001, and with 8-bit quantization the stopband 
approximation error is over 10 times as large as specified. Thus, we see that at least 14- 
bit coefficients are required for a direct-form implementation of the system. However, 
this is not a serious limitation, since 16-bit or 14-bit coefficients are well matched to 
many of the technologies that might be used to implement such a filter. 

The effect of quantization of the filter coefficients on the locations of the ze- 
ros of the filter is shown in Figure 6.47. Note that in the unquantized case, shown in 
Figure 6.47(a), the zeros are spread around the z-plane, although there is some clustering 
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Figure 6.47 Effect of impulse response quantization on zeros of H{z). (a) Un- 
quantized. (b) Sixteen-bit quantization, (c) Thirteen-bit quantization, (d) Eight-bit 
quantization. 
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on the unit circle. The zeros on the unit circle are primarily responsible for develop- 
ing the stopband attenuation, while those at conjugate reciprocal locations off the unit 
circle are primarily responsible for forming the passband. Note that little difference 
is observed in Figure 6.47(b) for 16-bit quantization, but in Figure 6.47(c), showing 
13-bit quantization, the zeros on the unit circle have moved significantly. Finally, in 
Figure 6.47(d), we see that 8-bit quantization causes several of the zeros on the unit 
circle to pair up and move off the circle to conjugate reciprocal locations. This behavior 
of the zeros is entirely consistent with the behavior of the frequency response shown in 
Figure 6.46. 

A final point about this example is worth mentioning. All of the unquantized 
coefficients have magnitudes less than 0.5. Consequently, if all of the coefficients (and 
therefore, the impulse response) are doubled prior to quantization, more efficient use 
of the available bits will result, corresponding in effect to increasing B by 1. In Table 6.3 
and Figure 6.46, we did not take this potential for increased accuracy into account. 

6.7.6 Maintaining Linear Phase 

So far, we have not made any assumptions about the phase response of the FIR sys- 
tem. However, the possibility of generalized linear phase is one of the major advan- 
tages of an FIR system. Recall that a linear-phase FIR system has either a symmetric 
(h[M — n] = h[n]) or an antisymmetric (h[M — n] = — h[n]) impulse response. These 
linear-phase conditions are easily preserved for the direct-form quantized system. Thus, 
all the systems discussed in the example of the previous subsection have a precisely linear 
phase, regardless of the coarseness of the quantization. This can be seen in the way in 
which the conjugate reciprocal locations are preserved in Figure 6.47. 

Figure 6.47(d) suggests that, in situations where quantization is very coarse or for 
high-order systems with closely spaced zeros, it may be worthwhile to realize smaller 
sets of zeros independently with a cascade-form FIR system. To maintain linear phase, 
each of the sections in the cascade must also have linear phase. Recall that the zeros of 
a linear-phase system must occur as illustrated in Figure 6.36. For example, if we use 
second-order sections of the form (1 + az~ l + z~ 2 ) for each complex-conjugate pair of 
zeros on the unit circle, the zero can move only on the unit circle when the coefficient a is 
quantized. This prevents zeros from moving away from the unit circle, thereby lessening 
their attenuating effect. Similarly, real zeros inside the unit circle and at the reciprocal 
location outside the unit circle would remain real. Also, zeros at z = ±1 can be realized 
exactly by first-order systems. If a pair of complex-conjugate zeros inside the unit circle 
is realized by a second-order system rather than a fourth-order system, then we must 
ensure that, for each complex zero inside the unit circle, there is a conjugate reciprocal 
zero outside the unit circle. This can be done by expressing the fourth-order factor 
corresponding to zeros at z = re^ e and z = r~ l e~i e as 

1 + cz~ l + dz~ 2 + cz~ 3 + z~ 4 

1 (f\ (\T\ 

= (1 - 2r cosflz- 1 +r 2 z" 2 )- i {r 2 - 2r cosflz -1 + z~ 2 ). 

This condition corresponds to the subsystem shown in Figure 6.48. This system uses the 
same coefficients, — 2r cosO and r 2 , to realize both the zeros inside the unit circle and 
the conjugate reciprocal zeros outside the unit circle. Thus, the linear-phase condition 
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Figure 6.48 Subnetwork to implement fourth-order factors in a linear-phase FIR 
system such that linearity of the phase is maintained independently of parameter 
quantization. 

is preserved under quantization. Notice that the factor (1 — 2rcos#z~ 1 + r 2 z~ 2 ) is 
identical to the denominator of the second-order direct-form IIR system of Figure 6.41. 
Therefore, the set of quantized zeros is as depicted in Figure 6.42. More details on 
cascade realizations of FIR systems are given by Herrmann and Schiissler (1970b). 



6.8 EFFECTS OF ROUND-OFF NOISE IN DIGITAL FILTERS 

Difference equations realized with finite-precision arithmetic are nonlinear systems. 
Although it is important in general to understand how this nonlinearity affects the per- 
formance of discrete-time systems, a precise analysis of arithmetic quantization effects 
is generally not required in practical applications, where we are typically concerned with 
the performance of a specific system. Indeed, just as with coefficient quantization, the 
most effective approach is often to simulate the system and measure its performance. 
For example, a common objective in quantization error analysis is to choose the digital 
word length such that the digital system is a sufficiently accurate realization of the de- 
sired linear system and at the same time requires a minimum of hardware or software 
complexity. The digital word length can, of course, be changed only in steps of 1 bit, and 
as we have already seen in Section 4.8.2, the addition of 1 bit to the word length reduces 
the size of quantization errors by a factor of 2. Thus, the choice of word length is insensi- 
tive to inaccuracies in the quantization error analysis; an analysis that is correct to within 
30-40% is often adequate. For this reason, many of the important effects of quantization 
can be studied using linear models. We develop such models in this section and illus- 
trate their use with several examples. An exception is the phenomenon of zero-input 
limit cycles, which are strictly nonlinear phenomena. We restrict our study of nonlinear 
models for digital filters to a brief introduction to zero-input limit cycles in Section 6.9. 



6.8.1 Analysis of the Direct-Form IIR Structures 

To introduce the basic ideas, let us consider the direct-form structure for a linear time- 
invariant discrete-time system. The flow graph of a direct form I second-order system 
is shown in Figure 6.49(a). The general Mh-order difference equation for the direct 
form I structure is 

N M 

y[n] = Y^ a *yl n ~ *1 + YL b * x [ n ~ k l ( 6 - 68 ) 



*=i 



*=o 
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Figure 6.49 Models for direct form 
I system, (a) Infinite-precision model. 

(b) Nonlinear quantized model. 

(c) Linear-noise model. 



and the system function is 



n(z) = 



M 



£^-< 



k=0 



N 



B(z) 
A(z) 



(6.69) 



Let us assume that all signal values and coefficients are represented by (B + 1)- 
bit fixed-point binary numbers. Then, in implementing Eq. (6.68) with a (B + l)-bit 
adder, it would be necessary to reduce the length of the (2B+ l)-bit products to (B + 1) 
bits. Since all numbers are treated as fractions, we would discard the least significant 
B bits by either rounding or truncation. This is represented by replacing each constant 
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multiplier branch in Figure 6.49(a) by a constant multiplier followed by a quantizer, 
as in the nonlinear model of Figure 6.49(b). The difference equation corresponding to 
Figure 6.49(b) is the nonlinear equation 

N M 

9[n] = £ Q[a k y[n -*]] + £ Q[b k x[n - *]]. (6.70) 

k=\ k=0 

Figure 6.49(c) shows an alternative representation in which the quantizers are 
replaced by noise sources that are equal to the quantization error at the output of each 
quantizer. For example, rounding or truncation of a product bx[n] is represented by a 
noise source of the form 

e[n] = Q[bx[n]] - bx[n]. (6.71) 

If the noise sources are known exactly, then Figure 6.49(c) is exactly equivalent to 
Figure 6.49(b). However, Figure 6.49(c) is most useful when we assume that each quan- 
tization noise source has the following properties: 

1. Each quantization noise source e[n] is a wide-sense-stationary white-noise process. 

2. Each quantization noise source has a uniform distribution of amplitudes over one 
quantization interval. 

3. Each quantization noise source is uncorrelated with the input to the corresponding 
quantizer, all other quantization noise sources, and the input to the system. 

These assumptions are identical to those made in the analysis of A/D conversion 
in Section 4.8. Strictly speaking, our assumptions here cannot be valid, since the quanti- 
zation error depends directly on the input to the quantizer. This is readily apparent for 
constant and sinusoidal signals. However, experimental and theoretical analyses have 
shown (see Bennett, 1948; Widrow, 1956, 1961) that in many situations the model just 
described leads to accurate predictions of statistical averages such as the mean, variance, 
and correlation function. This is true when the input signal is a complicated wideband 
signal such as speech, in which the signal fluctuates rapidly among all the quantization 
levels and traverses many of those levels in going from sample to sample (Gold and 
Rader, 1969). The simple linear-noise model presented here allows us to characterize 
the noise generated in the system by averages such as the mean and variance and to 
determine how these averages are modified by the system. 

For (B + l)-bit quantization, we showed in Section 6.6 that, for rounding, 

-\l- B < e[n] < X -2- B , (6.72a) 

and for two's-complement truncation, 

-2 _jB < e[n] < 0. (6.72b) 

Thus, according to our second assumption, the probability density functions for the 
random variables representing quantization error are the uniform densities shown in 
Figure 6.50(a) for rounding and in Figure 6.50(b) for truncation. The mean and variance 
for rounding are, respectively, 

m e = 0, (6.73a) 

o-25 

°] = -fi-. (6.73b) 
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Figure 6.50 Probability density 
function for quantization errors. 
(a) Rounding, (b) Truncation. 



For two's-complement truncation, the mean and variance are 

2~ B 



m„ = — 



2 ' 

2-2B 



^~n 



(6.74a) 



(6.74b) 



In general, the autocorrelation sequence of a quantization noise source is, according to 
the first assumption, 

<f> ee [n] = ^8[n] + m 2 e . (6.75) 



In the case of rounding, which we will assume for convenience henceforth, m e = 0, so the 
autocorrelation function is <f> ee [n] = a} S[n], and the power spectrum is ^ ee (e ja) ) = a] 
for \o)\ < n. In this case, the variance and the average power are identical. In the 
case of truncation, the mean is not zero, so average-power results derived for rounding 
must be corrected by computing the mean of the signal and adding its square to the 
average-power results for rounding. 

With this model for each of the noise sources in Figure 6.49(c), we can now proceed 
to determine the effect of the quantization noise on the output of the system. To aid 
us in doing this, it is helpful to observe that all of the noise sources in that figure are 
effectively injected between the part of the system that implements the zeros and the 
part that implements the poles. Thus, Figure 6.51 is equivalent to Figure 6.49(c) if e[n] 
in Figure 6.51 is 



e[n] = eo[n] + e x [n\ + e 2 [n] + e 3 [n] + e 4 [n]. 



(6.76) 



Since we assume that all the noise sources are independent of the input and independent 
of each other, the variance of the combined noise sources for the second-order direct 
form I case is 

2~2B 

= 5--^. (6.77) 



<*l = <*1 + <*l + <*l + ff£ + o} 



?0 



t\ 



*2 



?i 



?4 



12 
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Figure 6.51 Linear-noise model for direct form I with noise sources combined. 



and for the general direct form I case, it is 



-IB 



o* = (M+\ + N)'- 



12 



(6.78) 



To obtain an expression for the output noise, we note from Figure 6.51 that the 
system has two inputs, x[n\ and e[n], and since the system is now assumed to be linear, 
the output can be represented as y[n] = y[n] + f[n], where y[n] is the response of the 
ideal unquantized system to the input sequence x[n] and f[n] is the response of the 
system to the input e[ri\. The output y[n] is given by the difference equation (6.68), but 
since e[n] is injected after the zeros and before the poles, the output noise satisfies the 
difference equation 



N 



f[n] = '%2akf[n-k]+e[n]; 



(6.79) 



*=i 



i.e., the properties of the output noise in the direct form I implementation depend only 
on the poles of the system. 

To determine the mean and variance of the output noise sequence, we can use 
some results from Section 2.10. Consider a linear system with system function H e f(z) 
with a white-noise input e[n] and corresponding output f[n]. Then, from Eqs. (2.189) 
and (2.190), the mean of the output is 



mf — m e V^ h e f[n] = m e H e f(e }0 ). 



(6.80) 



Since m e = for rounding, the mean of the output will be zero, and we need not be 
concerned with the mean value of the noise if we assume rounding. From Eqs. (6.75) and 
(2.195), it follows that, because, for rounding, e[n] is a zero-mean white-noise sequence, 
the power density spectrum of the output noise is simply 



P ff {w) = <*f f (en = aj\H ef (e"")\ 2 - 
From Eq. (2.197), the variance of the output noise can be shown to be 

= ^f Pff(co)da> = er e 2 -L jT | tf„(*>")| 2 <fo. 



°) 



(6.81) 



(6.82) 
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Using Parseval's theorem in the form of Eq. (2.167), we can also express aj as 

oo 

<r}=a? £ \h ef [n]\ 2 . 



(6.83) 



When the system function corresponding to h e /[n] is a rational function, as it will always 
be for difference equations of the type considered in this chapter, we can use Eq. (A.66) 
in Appendix A for evaluating infinite sums of squares of the form of Eq. (6.83). 

We will use the results summarized in Eqs. (6.80)-(6.83) often in our analysis 
of quantization noise in linear systems. For example, for the direct form I system of 
Figure 6.51, H e f(z) — 1/A(z); i.e., the system function from the point where all the 
noise sources are injected to the output consists only of the poles of the system function 
H(z) in Eq. (6.69). Thus, we conclude that, in general, the total output variance due to 
internal round-off or truncation is 

2 -2B - * (6.84) 



12 



U \A(ei")p 

oo 

£ IM«]I 2 . 



where h e f[n] is the impulse response corresponding to H e f(z) = 1/A(z). The use of the 
preceding results is illustrated by the following examples. 

Example 6.9 Round-off Noise in a First-Order System 

Suppose that we wish to implement a stable system having the system function 



H(z) = 



1 - at 



-l ' 



lal < 1. 



(6.85) 



Figure 6.52 shows the flow graph of the linear-noise model for the implementation 
in which products are quantized before addition. Each noise source is filtered by the 
system from e[n] to the output, for which the impulse response is h e f[n] = a n u[n]. 
From Eq. (6.81), the power spectrum of the output noise is 



>-2fl 



Pff(*>) = 2 : 



1 



12 yi+a 2 —2a cos id 
The total noise variance at the output is 

)-2B J?L n-2B 

12 



<r 2 f = 2^J2^ 2n = 2 - 

n=0 



12 



1 



1-lfll 



(6.86) 



(6.87) 



e[n] = e a [n] + e b [n] 
b 




Figure 6.52 First-order linear noise model. 
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From Eq. (6.87), we see that the output noise variance increases as the pole at z = a 
approaches the unit circle. Thus, to maintain the noise variance below a specified level 
as \a\ approaches unity, we must use longer word lengths. The following example also 
illustrates this point. 

Example 6.10 Round-off Noise in 
a Second-Order System 

Consider a stable second-order direct form I system with system function 

H(z) = bo+ e b 'C + b2Z ~] n ■ (6-88) 

The linear-noise model for this system is shown in Figure 6.49(c) or, equivalently 
Figure 6.51, with a\ = 2r cos 6 and ai = — r 2 . In this case, the total output noise power 
can be expressed in the form 

° f " 12 In / |(1 - rc#e-'»)(l - r e -J*e-l°>)\ 2 ' ( ' ' 



Using Eq. (A.66) in Appendix A, the output noise power is found to be 

.J-^f^ L., ' . . (6.90) 



/ 12 \l-r 2 J r 4 + l-2r 2 cos20 

As in Example 6.9, we see that as the complex conjugate poles approach the unit circle 
(r — ► 1), the total output noise variance increases, thus requiring longer word lengths 
to maintain the variance below a prescribed level. 

The techniques of analysis developed so far for the direct form I structure can 
also be applied to the direct form II structure. The nonlinear difference equations for 
the direct form II structure are of the form 

N 

w[n] = ^2 Q[a k w[n - k]] + x[n], (6.91a) 

k=\ 

M 

5>M = £G[M>[«-*]]. (6.91b) 

fc=0 

Figure 6.53(a) shows the linear-noise model for a second-order direct form II system. A 
noise source has been introduced after each multiplication, indicating that the products 
are quantized to (B + 1) bits before addition. Figure 6.53(b) shows an equivalent linear 
model wherein we have moved the noise sources resulting from implementation of the 
poles and combined them into a single noise source e a [n] = ei[n] + e^n] at the input. 
Likewise, the noise sources due to implementation of the zeros are combined into the 
single noise source e&[«] = eo[n] + e\ [n] + ^M that is added directly to the output. From 
this equivalent model, it follows that for M zeros and N poles and rounding (m e = 0), 
the power spectrum of the output noise is 

2~2B 2~ 2B 

Pftlf») = N — \H(e<n\ 2 + (M+ 1) — , (6.92) 



398 



Structures for Discrete-Time Systems Chap. 6 



"* ? 1 



x[n] 



e 3 [n] 



T 

e 4 [n] 



<*2 

— « o 



«o[«] 



<? »"- 



r 



.1 e iH 



T 



PW 



(a) 






*["] 



«b\ n \ 



a 2 

— *- 



''Z~ 



-*■ Q 



"„-l 



(b) 



?[«] 



Figure 6.53 Linear-noise models for 
direct form II. (a) Showing quantization 
of individual products, (b) With noise 
sources combined. 



and the output noise variance is 

,-2B 



2 1 f n 

o} = N—-— |//(Ol 2 ^ + (M+l) : 
J 12 2k J_ n 

2~2B °° j-2B 



-IB 



12 



(6.93) 



That is, the white noise produced in implementing the poles is filtered by the entire 
system, while the white noise produced in implementing the zeros is added directly 
to the output of the system. In writing Eq. (6.93), we have assumed that the N noise 
sources at the input are independent, so that their sum has N times the variance of a 
single quantization noise source. The same assumption was made about the (M + 1) 
noise sources at the output. These results are easily modified for two's-complement 
truncation. Recall from Eqs. (6.73a)-(6.73b) and Eqs. (6.74a)-(6.74b) that the variance 
of a truncation noise source is the same as that of a rounding noise source, but the mean 
of a truncation noise source is not zero. Consequently, the formulas in Eqs. (6.84) and 
(6.93) for the total output noise variance also hold for truncation. However, the output 
noise will have a nonzero average value that can be computed using Eq. (6.80). 
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A comparison of Eq. (6.84) with Eq. (6.93) shows that the direct form I and direct 
form II structures are affected differently by the quantization of products in implement- 
ing the corresponding difference equations. In general, other equivalent structures such 
as cascade, parallel, and transposed forms will have a total output noise variance differ- 
ent from that of either of the direct-form structures. However, even though Eqs. (6.84) 
and (6.93) are different, we cannot say which system will have the smaller output noise 
variance unless we know specific values for the coefficients of the system. In other 
words, it is not possible to state that a particular structural form will always produce the 
least output noise. 

It is possible to improve the noise performance of the direct-form systems (and 
therefore cascade and parallel forms as well) by using a (2B+ l)-bit adder to accumulate 
the sum of products required in both direct-form systems. For example, for the direct 
form I implementation, we could use a difference equation of the form 



J>M = Q 



N 



M 



^2 a k9i n ~ k ] + X] bk *[ n ~ *] 



U=i 



£=0 



(6.94) 



i.e., the sums of products are accumulated with {IB + 1)- or (2B + 2)-bit accuracy, and 
the result is quantized to {B + 1) bits for output and storage in the delay memory. In the 
direct form I case, this means that the quantization noise is still filtered by the poles, but 
the factor (A/+1 + N)in Eq. (6.84) is replaced by unity. Similarly, for the direct form II 
realization, the difference equations (6.91a)-(6.91b) can respectively be replaced by 



w[n] = Q 



N 



^2ajcw[n - k] + x[n] 



lk=\ 



(6.95a) 



and 



y[n] = Q 



M 



y^J>kw[n- k] 



L*=o 



(6.95b) 



This implies a single noise source at both the input and output, so the factors N and 
(M + 1) in Eq. (6.93) are each replaced by unity. Thus, the double-length accumulator 
word provided in most DSP chips can be used to significantly reduce quantization noise 
in direct-form systems. 

6.8.2 Scaling in Fixed-Point Implementations of IIR Systems 

The possibility of overflow is another important consideration in the implementation 
of IIR systems using fixed-point arithmetic. If we follow the convention that each fixed- 
point number represents a fraction (possibly times a known scale factor), each node in 
the network must be constrained to have a magnitude less than unity to avoid overflow. If 
w k [n] denotes the value of the kth node variable and hk[ri\ denotes the impulse response 
from the input x[ri\ to the node variable w*[n], then 



\Wk[n]\ = 



y^ x[n — m]hk[m] 



(6.96) 
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The bound 

|H>Jk[#l]|<*max 5Z I**HI ( 6 *97) 

m=— oo 

is obtained by replacing x[n — m] by its maximum value jc max and using the fact that the 
magnitude of a sum is less than or equal to the sum of the magnitudes of the summands. 
Therefore, a sufficient condition for |wa:[ai]| < 1 is 

W < -55 (6.98) 



m=— oo 

for all nodes in the network. If jc max does not satisfy Eq. (6.98), then we can multiply 

x[n] by a scaling multiplier s at the input to the system so that sx max satisfies Eq. (6.98) 

for all nodes in the network; i.e., 

1 
sjw < ^—. -. (6.99) 



max 

k 



Yl i**ni 



Scaling the input in this way guarantees that overflow never occurs at any of the nodes 
in the network. Equation (6.98) is necessary as well as sufficient, since an input always 
exists such that Eq. (6.97) is satisfied with equality. (See Eq. (2.68) in the discussion of 
stability in Section 2.4.) However, Eq. (6.98) leads to a very conservative scaling of the 
input for most signals. 

Another approach to scaling is to assume that the input is a narrowband signal, 
modeled as x[n] = x max coscoon. In this case, the node variables will be 

Wk[n] = \H k (e>"»)\x max cos(co n + <H k (e^)). (6.100) 

Therefore, overflow is avoided for all sinusoidal signals if 

max \H k (en\x max <l (6.101) 

k,\a>\<Ji 

or if the input is scaled by the scale factor s such that 

1 

SXmax < .„ , :„. . (6.102) 

max \H k (e }( °)\ 

Still another approach is to scale the input so that the total energy of each node 
variable sequence is less than or equal to the total energy of the input sequence. We can 
derive the appropriate scale factor by applying the Schwarz inequality and Parse val's 
theorem. The total energy of the sequence w k [n] is bounded by 



V |m*[#i]| 2 = — / \H k (enX(en\ 2 dco 



< 



Y, l*MI 2 2^ / ltf*(«'")l 2 <k>- 



(6.103) 



rt=— oo 
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Therefore, to ensure that ^ t^fcWl 2 < 5Z I^Ml 2 * we can multiply the sequence x[n] by 
a scale factor 5 such that 



s 2 < 



1 



1 



- 1 

2 



-J Me>")\ 2 da> ^ IM"]I 



It can be shown that 



1/2 



V \k k [n]\ 2 \ < max | //*(*>») |< V \h k [n]\ 



(6.104) 



(6.105) 



Hence, Eqs. (6.99), (6.102), and (6.104) give three decreasingly conservative ways of 
obtaining scaling multipliers for the input to a digital filter. Of the three, Eq. (6.104) is 
generally the easiest to evaluate analytically, because the sum of squares can be eval- 
uated by the partial fraction method described in Appendix A. On the other hand, 
Eq. (6.99) is difficult to evaluate analytically, except for the simplest systems. Of course, 
for specific systems with known coefficients, the scale factors can be estimated by com- 
puting the impulse response or frequency response numerically. 

If the input must be scaled down (s < 1), the signal-to-noise ratio at the output 
of the system will be reduced. Figure 6.54 shows second-order direct form I and direct 
form II systems with scaling multipliers at the input. In determining the scaling multiplier 
for these systems, it is not necessary to examine each node in the network. Some nodes 
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Figure 6.54 Scaling of direct form 
systems, (a) Direct form I. (b) Direct 
form II. 
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do not represent addition and thus cannot overflow. Other nodes represent partial 
sums. If we use nonsaturation two's-complement arithmetic, such nodes are permitted 
to overflow if certain key nodes do not. For example, in Figure 6.54(a), we can focus 
on the node enclosed by the dashed circle. In the figure, the scaling multiplier is shown 
combined with the b k y s, so that the noise source is the same as in Figure 6,51; i.e., it has 
five times the power of a single quantization noise source. 7 Since the noise source is 
again filtered only by the poles, the output noise power is the same in Figures 6.51 and 
6.54(a). However, the overall system function of the system in Figure 6.54(a) is sH(z) 
instead of H(z), so the'unquantized component of the output y[n] is sy[n] instead of 
y[n]. Since the noise is injected after the scaling, the ratio of signal power to noise power 
in the scaled system is s 2 times the signal-to-noise ratio for Figure 6.51. Because s < 1 
if scaling is required to avoid overflow, the signal-to-noise ratio is reduced by scaling. 

The same is true for the direct form II system of Figure 6.54(b). In this case, we 
must determine the scaling multiplier to avoid overflow at both of the circled nodes. 
Again, the overall gain of the system is s times the gain of the system in Figure 6.53(b), 
but it may be necessary to implement the scaling multiplier explicitly in this case to 
avoid overflow at the node on the left. This scaling multiplier adds an additional noise 
component to e a [n], so the noise power at the input is, in general, (N + 1)2 _2B /12. 
Otherwise, the noise sources are filtered by the system in exactly the same way in both 
Figure 6.53(b) and Figure 6.54(b). Therefore, the signal power is multiplied by s 2 , and 
the noise power at the output is again given by Eq. (6.93), with N replaced by (N + 1). 
The signal-to-noise ratio is again reduced if scaling is required to avoid overflow. 

Example 6.11 Interaction Between Scaling 
and Round-off Noise 

To illustrate the interaction of scaling and round-off noise, consider the system of 
Example 6.9 with system function given by Eq. (6.85). If the scaling multiplier is 
combined with the coefficient b, we obtain the flow graph of Figure 6.55 for the scaled 
system. Suppose that the input is white noise with amplitudes uniformly distributed 
between —1 and +1. Then the total signal variance is cr 2 = 1/3. To guarantee no 
overflow in computing y[n], we use Eq. (6.99) to compute the scale factor 

-^^ = ^. (6-106) 

The output noise variance was determined in Example 6.9 to be 

2 -2S i 

CT 2 = 2 = ^2 (6.107) 

f 12 1 - a 2 f K } 

and the variance of the output y'[n] is 

ct /=G)S=^- (6 - io8) 



7 This eliminates a separate scaling multiplication and quantization noise source. However, scaling (and 
quantizing) the b^s can change the frequency response of the system. If a separate input scaling multiplier 
precedes the implementation of the zeros in Figure 6.54(a), then an additional quantization noise source 
would contribute to the output noise after going through the entire system H(z)- 
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y[n] = sy[n]+f'[n] 



Figure 6.55 Scaled first-order system. 



Therefore, the signal-to-noise ratio is 



4 2 ° 2 y fl-\ a \\ 2 ^ 



a 



2 _J „2 ~ \ \h\ ) „2 



= *^= —7^) "4- (6-109) 



f Of \ 1^1 / Of 

As the pole of the system abproaches the unit circle, the signal-to-noise ratio decreases 
because the quantization noise is amplified by the system and because the high gain 
of the system forces the input to be scaled down to avoid overflow. Again, we see that 
overflow and quantization noise work in opposition to decrease the performance of 
the system. 



6.8.3 Example of Analysis of a Cascade III? Structure 

The previous results of this section can be applied directly to the analysis of either 
parallel or cascade structures composed of second-order direct-form subsystems. The 
interaction of scaling and quantization is particularly interesting in the cascade form. 
Our general comments on cascade systems will be interwoven with a specific example. 
An elliptic lowpass filter was designed to meet the following specifications: 

0.99 < \H(ei°>)\ < 1.01, \a>\ < 0.5tt, 
\H(eJ<°)\ < 0.01, 0.56tt < \o>\ < n. 

The system function of the resulting system is 

H(z) - 0.079459 f[ ( / + blk * +Z . ) = 0.079459 T7 H k (z), (6.110) 
JT=i V ! - a \kZ~ x - a 2k z~ 2 J ^ 

where the coefficients are given in Table 6.4. Notice that all the zeros of H(z) are on 
the unit circle in this example; however, that need not be the case in general. 

TABLE 6.4 COEFFICIENTS FOR 
ELLIPTIC LOWPASS FILTER IN 
CASCADE FORM 



k a\k G2k oiit 

1 0.478882 -0.172150 1.719454 

2 0.137787 -0.610077 0.781109 

3 -0.054779 -0.902374 0.411452 
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0.079459 

o *■ 



x[n] 



Figure 6.56(a) shows a flow graph of a possible implementation of this system 
as a cascade of second-order transposed direct form II subsystems. The gain constant, 
0.079459, is such that the overall gain of the system is approximately unity in the pass- 
band, and it is assumed that this guarantees no overflow at the output of the system. 
Figure 6.56(a) shows the gain constant placed at the input to the system. This approach 
reduces the amplitude of the signal immediately, with the result that the subsequent 
filter sections must have high gain to produce an overall gain of unity. Since the quanti- 
zation noise sources are introduced after the gain of 0.079459, but are likewise amplified 
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Figure 6.56 Models for sixth-order cascade system with transposed direct form II sub- 
systems, (a) Infinite-precision model, (b) Linear-noise model for scaled system, show- 
ing quantization of individual multiplications, (c) Linear-noise model with noise sources 
combined. 
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by the rest of the system, this is not a good approach. Ideally, the overall gain constant, 
being less than unity, should be placed at the very end of the cascade, so that the signal 
and noise will be attenuated by the same amount. However, this creates the possibility 
of overflow along the cascade. Therefore, a better approach is to distribute the gain 
among the three stages of the system so that overflow is just avoided at each stage of 
the cascade. This distribution is represented by 



H(z)=s 1 H 1 (z)s 2 H 2 (z)s 3 H 3 (z), 



(6.111) 



where s\s 2 s 3 = 0.079459. The scaling multipliers can be incorporated into the coeffi- 
cients of the numerators of the individual system functions H f k {z) = s*//jt(z), as in 

m = n i ^-a^-^ ) = n w- «- ii2 > 

where b' Qk = b 2k = Sk and b' lk = s k b\k> The resulting scaled system is depicted in 
Figure 6.56(b). 

Also shown in Figure 6.56(b) are quantization noise sources representing the 
quantization of the products before addition. Figure 6.56(c) shows an equivalent noise 
model, for which it is recognized that all the noise sources in a particular section are 
filtered only by the poles of that section (and the subsequent subsystems). Figure 6.56(c) 
also uses the fact that delayed white-noise sources are still white noise and are inde- 
pendent of all the other noise sources, so that all five sources in a subsection can be 
combined into a single noise source having five times the variance of a single quantiza- 
tion noise source. 8 Since the noise sources are assumed independent, the variance of the 
output noise is the sum of the variances due to the three noise sources in Figure 6.56(c). 
Therefore, for rounding, the power spectrum of the output noise is 



Pff(co) = 5- 



)~2B 



12 



s 2 \H 2 (e>»)\ 2 s 2 \H 3 (e>»)F s 2 \H 3 (e^)\ 2 



\Ai(eJ<°)\ 2 \A 2 (e>")\ 2 

and the total output noise variance is 

** s 2 \H 2 {e><»)\ 2 s 2 \H 3 {e>")\ 2 
\A!(e>*>)\ 2 



\A 3 (e^)\ : 



(6.113) 




dw 



+ r 



H 



" s 2 3 \H 3 {e>«>)[ 
_ n \A 2 {e>")\ 2 



d(o + 



1 r 



(6.114) 



_„ \A 3 (e>»)\ 2 



dco 



If a double-length accumulator is available, it would be necessary to quantize only 
the sums that are the inputs to the delay elements in Figure 6.56(b). In this case the 
factor of 5 in Eqs. (6.113) and (6.114) would be changed to 3. Furthermore, if a double- 
length register were used to implement the delay elements, only the variables Wk[n] 
would have to be quantized, and there would be only one quantization noise source per 
subsystem. In that case, the factor of 5 in Eqs. (6.113) and (6.114) would be changed to 
unity. 



8 This discussion can be generalized to show that the transposed direct form II has the same noise 
behavior as the direct form I system. 
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The scale factors s^ are chosen to avoid overflow at points along the cascade system. 
We will use the scaling convention of Eq. (6.102). Therefore, the scaling constants are 
chosen to satisfy 

s ] max\H l (e jl °)\ < 1, (6.115a) 

\<o\<7T 

Sl s 2 max\H l (e jw )H 2 (e jw )\ < 1, (6.115b) 

\co\<TC 

sis 2 s 3 =0.079459. (6.115c) 

The last condition ensures that there will be no overflow at the output of the system 
for unit-amplitude sinusoidal inputs, because the maximum overall gain of the filter is 
unity. For the coefficients of Table 6.4, the resulting scale factors are s\ = 0.186447, $2 = 
0.529236, and s 3 = 0.805267. 

Equations (6.1 13) and (6.114) show that the shape of the output noise power spec- 
trum and the total output noise variance depends on the way that zeros and poles are 
paired to form the second-order sections and on the order of the second-order sections in 
the cascade-form realization. Indeed, it is easily seen that, for N sections, there are (TV!) 
ways to pair the poles and zeros, and there are likewise (TV!) ways to order the resulting 
second-order sections, a total of (TV!) 2 different systems. In addition, we can choose 
either direct form I or direct form II (or their transposes) for the implementation of the 
second-order sections. In our example, this implies that there are 144 different cascade 
systems to consider if we wish to find the system with the lowest output noise variance. 
For five cascaded sections, there would be 57,600 different systems ! Clearly, the complete 
analysis of even low-order systems is a tedious task, since an expression like Eq. (6.114) 
must be evaluated for each pairing and ordering. Hwang (1974) used dynamic pro- 
gramming and Liu and Peled (1975) used a heuristic approach to reduce the amount of 
computation. Dehner's program for the design and analysis of cascade-form IIR filters 
includes the optimization of both pairing and ordering (DSP Committee, 1979). 

In spite of the difficulty of finding the optimum pairing and ordering, Jackson 
(1970a, 1970b, 1996) found that good results are almost always obtained by applying 
simple rules of the following form: 

1. The pole that is closest to the unit circle should be paired with the zero that is 
closest to it in the z-plane. 

2. Rule 1 should be repeatedly applied until all the poles and zeros have been paired. 

3. The resulting second-order sections should be ordered according to either increas- 
ing closeness to the unit circle or decreasing closeness to the unit circle. 

The pairing rules are based on the observation that subsystems with high peak 
gain are undesirable because they can cause overflow and because they can amplify 
quantization noise. Pairing a pole that is close to the unit circle with an adjacent zero 
tends to reduce the peak gain of that section. 

One motivation for rule 3 is suggested by Eq. (6.1 13). We see that the frequency re- 
sponses of some of the subsystems appear more than once in the equation for the power 
spectrum of the output noise. If we do not want the output noise variance spectrum to 
have a high peak around a pole that is close to the unit circle, then it is advantageous 
to have the frequency-response component due to that pole not appear frequently in 
Eq. (6.113). This suggests moving such "high Q" poles to the beginning of the cascade. 
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Figure 6.57 Pole-zero plot for 
sixth-order system of Figure 6.56, 
showing pairing of poles and zeros. 



On the other hand, the frequency response from the input to a particular node in the 
network will involve a product of the frequency responses of the subsystems that pre- 
cede the node. Thus, to avoid excessive reduction of the signal level in the early stages 
of the cascade, we should place the poles that are close to the unit circle last in order. 
Clearly, then, the question of ordering hinges on a variety of considerations, including 
total output noise variance and the shape of the output noise spectrum. Jackson (1970a, 
1970b) used L p norms to quantify the analysis of the pairing-and-ordering problem and 
gave a much more detailed set of "rules of thumb" for obtaining good results without 
having to evaluate all possibilities. 

The pole-zero plot for the system in our example is shown in Figure 6.57. The 
paired poles and zeros are circled. In this case, we have chosen to order the sections 
from least peaked to most peaked frequency response. Figure 6.58 illustrates how the 
frequency responses of the individual sections combine to form the overall frequency 
response. Figures 6.58(a)-(c) show the frequency responses of the individual unsealed 
subsystems. Figures 6.58(d)-(f) show how the overall frequency response is built up. 
Notice that Figures 6.58(d)-(f) demonstrate that the scaling equations (6.1 15a)-(6.1 15c) 
ensure that the maximum gain from the input to the output of any subsystem is less 
than unity. The solid curve in Figure 6.59 shows the power spectrum of the output noise 
for the ordering 123 (least peaked to most peaked). We assume that B + 1 = 16 for the 
plot. Note that the spectrum peaks in the vicinity of the pole that is closest to the unit 
circle. The dotted curve shows the power spectrum of the output noise when the section 
order is reversed (i.e., 321). Since section 1 has high gain at low frequencies, the noise 
spectrum is appreciably larger at low frequencies and slightly lower around the peak. 
The high Q pole still filters the noise sources of the first section in the cascade, so it still 
tends to dominate the spectrum. The total noise power for the two orderings turns out 
to be almost the same in this case. 
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Figure 6.58 Frequency-response 
functions for example system. 
(a)20IOQiol«i(en 
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spectrum for 123 ordering (solid line) 
and 321 ordering of second-order 
sections. 

The example we have just presented shows the complexity of the issues that arise 
in fixed-point implementations of cascade IIR systems. The parallel form is somewhat 
simpler because the issue of pairing and ordering does not arise. However, scaling is still 
required to avoid overflow in individual second-order subsystems and when the outputs 
of the subsystems are summed to produce the overall output. The techniques that we 
have developed must therefore be applied for the parallel form as well. Jackson (1996) 
discusses the analysis of the parallel form in detail and concludes thafits total output 
noise power is typically comparable to that of the best pairings and orderings of the cas- 
cade form. Even so, the cascade form is more common, because, for widely used IIR fil- 
ters such that the zeros of the system function are on the unit circle, the cascade form 
can be implemented with fewer multipliers and with more control over the locations of 
the zeros. 



6.8.4 Analysis of Direct-Form FIR Systems 

Since the direct form I and direct form II IIR systems include the direct-form FIR sys- 
tem as a special case (i.e., the case where all a^s in Figures 6.14 and 6.15 are zero), the 
results and analysis techniques of Sections 6.8.1 and 6.8.2 apply to FIR systems if we 
eliminate all reference to the poles of the system function and eliminate the feedback 
paths in all the signal flow graphs. 

The direct-form FIR system is simply the discrete convolution 



M 



y[n} = Y J h[k]x[n-k\ 



(6.116) 



*=o 



Figure 6.60(a) shows the ideal unquantized direct-form FIR system, and Figure 6.60(b) 
shows the linear-noise model for the system, assuming that all products are quantized 
before additions are performed. The effect is to inject (M + 1) white-noise sources 
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Figure 6.60 Direct-form realization of an FIR system, (a) Infinite-precision model, 
(b) Linear-noise model. 

directly at the output of the system, so that the total output noise variance is 



o} = (M+\) 



i-2B 



12 



(6.117) 



This is exactly the result we would obtain by setting N = and /i e /[/i] = S[n] in 
Eqs. (6.84) and (6.93). When a double-length accumulator is available, we would need 
to quantize only the output. Therefore, the factor (M + 1) in Eq. (6.117) would be 
replaced by unity. This makes the double-length accumulator a very attractive hardware 
feature for implementing FIR systems. 

Overflow is also a problem for fixed-point realizations of FIR systems in direct 
form. For two's-complement arithmetic, we need to be concerned only about the size 
of the output, since all the other sums in Figure 6.60(b) are partial sums. Thus, the 
impulse-response coefficients can be scaled to reduce the possibility of overflow. Scaling 
multipliers can be determined using any of the alternatives discussed in Section 6.8.2. 
Of course, scaling the impulse response reduces the gain of the system, and therefore 
the signal-to-noise ratio at the output is reduced as discussed in that section. 

Example 6.12 Scaling Considerations for the FIR System 
in Section 6.7.5 

The impulse-response coefficients for the system in Section 6.7.5 are given in 
Table 6.3. A simple calculation shows, and from Figure 6.46(b) we see, that 

27 

^|%]| = 1.751352, 




max | //(O | % 1.009. 

M<7T 
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These numbers satisfy the relationship in Eq. (6.105). Thus, the system, as given, is 
scaled so that overflow is theoretically possible for a sinusoidal signal whose amplitude 
is greater than 1/1.009 = 0.9911, but even so, overflow is unlikely for most signals. 
Indeed, since the filter has a linear phase, we can argue that, for wideband signals, 
since the gain in the passband is approximately unity and the gain elsewhere is less 
than unity, the output signal should be smaller than the input signal. 

In Section 6.5.3, we showed that linear-phase systems like the one in Example 6.12 
can be implemented with about half the number of multiplications of the general FIR 
system. This is evident from the signal flow graphs of Figures 6.34 and 6.35. In these 
cases, it should be clear that the output noise variance would be halved if products 
were quantized before addition. However, the utilization of such structures involves a 
more complicated indexing algorithm than the direct form. The architecture of most 
DSP chips combines a double-length accumulator with an efficient pipelined multiply- 
accumulate operation and simple looping control to optimize for the case of the direct- 
form FIR system. For this reason, direct-form FIR implementations are often most 
attractive, even compared with IIR filters that meet frequency-response specifications 
with fewer multiplications. 

In Section 6.5.3, we discussed cascade realizations of FIR systems. The results 
and analysis techniques of Section 6.8.3 apply to these realizations; but for FIR systems 
with no poles, the pairing and ordering problem reduces to just an ordering problem. 
As in the case of IIR cascade systems, the analysis of all possible orderings can be 
very difficult if the system is composed of many subsystems. Chan and Rabiner (1973a, 
1973b) studied this problem and found experimentally that the noise performance is 
relatively insensitive to the ordering. Their results suggest that a good ordering is an 
ordering for which the frequency response from each noise source to the output is 
relatively flat and for which the peak gain is small. 



6.8.5 Floating-Point Realizations of Discrete-Time Systems 

From the preceding discussion, it is clear that the limited dynamic range of fixed-point 
arithmetic makes it necessary to carefully scale the input and intermediate signal levels 
in fixed-point digital realizations of discrete-time systems. The need for such scaling 
can be essentially eliminated by using floating-point numerical representations and 
floating-point arithmetic. 

In floating-point representations, a real number x is represented by the binary 
number 2 c xm, where the exponent c of the scale factor is called the characteristic and 
xm is a fractional part called the mantissa. Both the characteristic and the mantissa are 
represented explicitly as fixed-point binary numbers in floating-point arithmetic sys- 
tems. Floating-point representations provide a convenient means for maintaining both 
a wide dynamic range and low quantization noise; however, quantization error mani- 
fests itself in a somewhat different way. Floating-point arithmetic generally maintains its 
high accuracy and wide dynamic range by adjusting the characteristics and normalizing 
the mantissa so that 0.5 < xm < 1. When floating-point numbers are multiplied, their 
characteristics are added and their mantissas are multiplied. Thus, the mantissa must 
be quantized. When two floating-point numbers are added, their characteristics must 
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be adjusted to be the same by moving the binary point of the mantissa of the smaller 
number. Hence, addition results in quantization, too. If we assume that the range of the 
characteristic is sufficient so that no numbers become larger than 2 C , then quantization 
affects only the mantissa, but the error in the mantissa is also scaled by 2 C . Thus, a 
quantized floating-point number is conveniently represented as 

x = jc(1 + e) = x + ex. (6.118) 

By representing the quantization error as a fraction e of x, we automatically represent 
the fact that the quantization error is scaled up and down with the signal level. 

The aforementioned properties of floating-point arithmetic complicate the quan- 
tization error analysis of floating-point implementations of discrete-time systems. First, 
noise sources must be inserted both after each multiplication and after each addition. 
An important consequence is that, in contrast to fixed-point arithmetic, the order in 
which multiplications and additions are performed can sometimes make a big differ- 
ence. More important for analysis, we can no longer justify the assumption that the 
quantization noise sources are white noise and are independent of the signal. In fact, in 
Eq. (6.118), the noise is expressed explicitly in terms of the signal. Therefore, we can 
no longer analyze the noise without making assumptions about the nature of the input 
signal. If the input is assumed to be known (e.g., white noise), a reasonable assumption 
is that the relative error e is independent of x and is uniformly distributed white noise. 

With these types of assumptions, useful results have been obtained by Sandberg 
(1967), Liu and Kaneko (1969), Weinstein and Oppenheim (1969), and Kan and 
Aggarwal (1971). In particular, Weinstein and Oppenheim, comparing floating-point 
and fixed-point realizations of first- and second-order IIR systems, showed that if the 
number of bits representing the floating-point mantissa is equal to the length of the 
fixed-point word, then floating-point arithmetic leads to higher signal-to-noise ratio at 
the output. Not surprisingly, the difference was found to be greater for poles close to 
the unit circle. However, additional bits are required to represent the characteristic, and 
the greater the desired dynamic range, the more bits are required for the characteristic. 
Also, the hardware to implement floating-point arithmetic is much more complex than 
that for fixed-point arithmetic. Therefore, the use of floating-point arithmetic entails 
an increased word length and increased complexity in the arithmetic unit. Its major 
advantage is that it essentially eliminates the problem of overflow, and if a sufficiently 
long mantissa is used, quantization also becomes much less of a problem. This translates 
into greater simplicity in system design and implementation. 

6.9 ZERO-INPUT LIMIT CYCLES IN FIXED-POINT 
REALIZATIONS OF IIR DIGITAL FILTERS 

For stable IIR discrete-time systems implemented with infinite-precision arithmetic, 
if the excitation becomes zero and remains zero for n greater than some value «o> 
the output for n > «o will decay asymptotically toward zero. For the same system, 
implemented with finite-register-length arithmetic, the output may continue to oscillate 
indefinitely with a periodic pattern while the input remains equal to zero. This effect is 
often referred to as zero-input limit cycle behavior and is a consequence either of the 
nonlinear quantizers in the feedback loop of the system or of overflow of additions. The 
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limit cycle behavior of a digital filter is complex and difficult to analyze, and we will not 
attempt to treat the topic in any general sense. To illustrate the point, however, we will 
give two simple examples that will show how such limit cycles can arise. 



6.9.1 Limit Cycles due to Round-off and Truncation 

Successive round-off or truncation of products in an iterated difference equation can 
create repeating patterns. This is illustrated in the following example. 

Example 6.1 3 Limit Cycle Behavior 
in a First-Order System 

Consider the first-order system characterized by the difference equation 

y[ri\=ay[n-l] + x[n], \a\<l. (6.119) 

The signal flow graph of this system is shown in Figure 6.61(a). Let us assume 
that the register length for storing the coefficient a, the input x[n], and the filter node 
variable y[n — 1] is 4 bits (i.e., a sign bit to the left of the binary point and 3 bits to the 




(a) 




(b) 

Figure 6.61 First-order MR system, (a) Infinite-precision linear system, (b) Non- 
linear system due to quantization. 

right of the binary point). Because of the finite-length registers, the product ay[n — 1] 
must be rounded or truncated to 4 bits before being added to x[n]. The flow graph 
representing the actual realization based on Eq. (6.119) is shown in Figure 6.61(b). 
Assuming rounding of the product, the actual output y[n] satisfies the nonlinear dif- 
ference equation 



y[n]=Q[ay[n-l]] + x[n], 



(6.120) 



where Q[] represents the rounding operation. Let us assume that a = 1/2 = o 100 
and that the input is x[n] = (7/8)%] = (0 o lll)5[n]. Using Eq. (6.120), we see that for 
n = 0, y[0] = 7/8 = o lll. To obtain y[l], we multiply y[0] by a, obtaining the result 
ay[Q] = o 011 100, a 7-bit number that must be rounded to 4 bits. This number, 7/16, 
is exactly halfway between the two 4-bit quantization levels 4/8 and 3/8. If we choose 
always to round upward in such cases, then o 011100 rounded to 4 bits is o 100 ~ 1/2. 
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Since x[l] = 0, it follows that y[l] = o 100 = 1/2. Continuing to iterate the difference 
equation gives y[2] = Q[ay[l]] = o 010 = 1/4 and y[3] = o 001 = 1/8. In both 
these cases, no rounding is necessary. However, to obtain >>[4], we must round the 
7-bit number ay[3] = o 000100 to o 001. The same result is obtained for all values of 
n > 3. The output sequence for this example is shown in Figure 6.62(a). If a = —1/2, 
we can carry out the preceding computation again to demonstrate that the output is as 
shown in Figure 6.62(b). Thus, because of rounding of the product ay[n — 1], the output 
reaches a constant value of 1/8 when a — 1/2 and a periodic steady-state oscillation 
between +1/8 and —1/8 when a = —1/2. These are periodic outputs similar to those 
that would be obtained from a first-order pole at z = ±1 instead of at z = ±1/2. 

7 
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Figure 6.62 Response of the first-order system of Figure 6.61 to an impulse. 
(a)a = J.(b)a = -J. 
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When a = +1/2, the period of the oscillation is 1, and when a — -1/2, the period 
of oscillation is 2. Such steady-state periodic outputs are called limit cycles, and their 
existence was first noted by Blackman (1965), who referred to the amplitude intervals 
to which such limit cycles are confined as dead bands. In this case the dead band is 
-2~ B < y[n] < +2~ B , where B = 3. 

The foregoing example has illustrated that a zero-input limit cycle can result 
from rounding in a first-order IIR system. Similar results can be demonstrated for 
truncation. Second-order systems can also exhibit limit cycle behavior. In the case of 
parallel realizations of higher order systems, the outputs of the individual second-order 
systems are independent when the input is zero. In this case, one or more of the second- 
order sections could contribute a limit cycle to the output sum. In the case of cascade 
realizations, only the first section has zero input; succeeding sections may exhibit their 
own characteristic limit cycle behavior, or they may appear to be simply filtering the 
limit cycle output of a previous section. For high-order systems realized by other filter 
structures, the limit cycle behavior becomes more complex, as does its analysis. 

In addition to giving an understanding of limit cycle effects in digital niters, the 
preceding results are useful when the zero-input limit cycle response of a system is the 
desired output. This is the case, for example, when one is concerned with digital sine 
wave oscillators for signal generation or for the generation of coefficients for calculation 
of the discrete Fourier transform. 



6.9.2 Limit Cycles Due to Overflow 

In addition to the classes of limit cycles discussed in the preceding section, a more severe 
type of limit cycle can occur due to overflow. The effect of overflow is to insert a gross 
error in the output, and in some cases the filter output thereafter oscillates between 
large-amplitude limits. Such limit cycles have been referred to as overflow oscillatidh. 
The problem of oscillations caused by overflow is discussed in detail by Ebert et al. 
(1969). Overflow oscillations are illustrated by the following example. 

Example 6.14 Overflow Oscillations 
in a Second-Order System 

Consider a second-order system realized by the difference equation 

y[n] = x[n] + Q[a,y[n - 1]] + Q[a 2 y[n - 2]], (6.121) 

where Q[] represents two's-complement rounding with a word length of 3 bits plus 1 
bit for the sign. Overflow can occur with two's-complement addition of the rounded 
products. Suppose that a\ = 3/4 = o 110 and a-i = —3/4 = l o 010, and assume that 
jc[/j] remains equal to zero for n > 0. Furthermore, assume that y[— 1] = 3/4 = o 110 
and y[—2] = -3/4 = l o 010. Now the output at sample n = is 

y[0] = o 110 x o 110 + U010 x l c 010. 

If we evaluate the products using two's-complement arithmetic, we obtain 

y[0] = OJOOIOO + (U00100, 
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and if we choose to round upward when a number is halfway between two quantization 
levels, the result of two's-complement addition is 

5>[0] = OolOl +0 o 101 = l o 010 = -f . 

In this case the binary carry overflows into the sign bit, thus changing the positive sum 
into a negative number. Repeating the process gives 

y[l] = l o 011 + l o 011 = o 110 = \. 

The binary carry resulting from the sum of the sign bits is lost, and the negative sum is 
mapped into a positive number. Clearly, y[n] will continue to oscillate between +3/4 
and —3/4 until an input is applied. Thus, y[n] has entered a periodic limit cycle with a 
period of 2 and an amplitude of almost the full-scale amplitude of the implementation. 

The preceding example illustrates how overflow oscillations occur. Much more 
complex behavior can be exhibited by higher order systems, and other frequencies 
can occur. Some results are available for predicting when overflow oscillations can be 
supported by a difference equation (Ebert et al., 1969). Overflow oscillations can be 
avoided by using the saturation overflow characteristic of Figure 6.38(b) (Ebert et al., 
1969). 



6.9.3 Avoiding Limit Cycles 

The possible existence of a zero-input limit cycle is important in applications where a 
digital filter is to be in continuous operation, since it is generally desired that the output 
approach zero when the input is zero. For example, suppose that a speech signal is 
sampled, filtered by a digital filter, and then converted back to an acoustic signal using 
a D/A converter. In such a situation it would be very undesirable for the filter to enter 
a periodic limit cycle whenever the input is zero, since the limit cycle would produce an 
audible tone. 

One approach to the general problem of limit cycles is to seek structures that do 
not support limit cycle oscillations. Such structures have been derived by using state- 
space representations (Barnes and Fam, 1977; Mills et al., 1978) and concepts analogous 
to passivity in analog systems (Rao and Kailath, 1984; Fettweis, 1986). However, these 
structures generally require more computation than an equivalent cascade- or parallel- 
form implementation. By adding more bits to the computational word length, we can 
generally avoid overflow. Similarly, since round-off limit cycles usually are limited to the 
least significant bits of the binary word, additional bits can be used to reduce the effective 
amplitude of the limit cycle. Also, Claasen et al. (1973) showed that if a double-length 
accumulator is used so that quantization occurs after the accumulation of products, then 
limit cycles due to round-off are much less likely to occur in second-order systems. Thus, 
the trade-off between word length and computational algorithm complexity arises for 
limit cycles just as it does for coefficient quantization and round-off noise. 

Finally, it is important to point out that zero-input limit cycles due to both over- 
flow and round -off are a phenomenon unique to IIR systems: FIR systems cannot 
support zero-input limit cycles, because they have no feedback paths. The output of an 
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FIR system will be zero no later than (M + 1) samples after the input goes to zero and 
remains there. This is a major advantage of FIR systems in applications wherein limit 
cycle oscillations cannot be tolerated. 

6.10 SUMMARY 

In this chapter, we have considered many aspects of the problem of implementing a 
linear time-invariant discrete-time system. The first half of the chapter was devoted 
to basic implementation structures. After introducing block diagram and signal flow 
graphs as pictorial representations of difference equations, we discussed a number of 
basic structures for IIR and FIR discrete-time systems. These included the direct form I, 
direct form II, cascade form, parallel form, and transposed form. We showed that these 
forms are all equivalent when implemented with infinite-precision arithmetic. However, 
the different structures are most significant in the context of finite-precision implemen- 
tations. Therefore, the remainder of the chapter addressed problems associated with 
finite precision or quantization in digital implementations of the basic structures. 

We began the discussion of finite precision effects with a brief review of digital 
number representation and an overview which showed that the quantization effects that 
are important in sampling (discussed in Chapter 4) are also important in representing the 
coefficients of a discrete-time system and in implementing systems using finite-precision 
arithmetic. We illustrated the effect of quantization of the coefficients of a difference 
equation through several examples. This issue was treated independently of the effects 
of finite-precision arithmetic, which we showed introduces nonlinearity into the system. 
We demonstrated that in some cases this nonlinearity was responsible for limit cycles 
that may persist after the input to a system has become zero. We also showed that quan- 
tization effects can be modeled in terms of independent random white-noise sources 
that are injected internally into the network. Such linear-noise models were developed 
for the direct-form structures and for the cascade structure. In all of our discussion of 
quantization effects, the underlying theme was the conflict between the desire for fine 
quantization and the need to maintain a wide range of signal amplitudes. We saw that 
in fixed-point implementations, one can be improved at the expense of the other, but to 
improve one while leaving the other unaffected requires that we increase the number 
of bits used to represent coefficients and signal amplitudes. This can be done either by 
increasing the fixed-point word length or by adopting a floating-point representation. 

Our discussion of quantization effects serves two purposes. First, we developed 
several results that can be useful in guiding the design of practical implementations. We 
found that quantization effects depend greatly on the structure used and on the specific 
parameters of the system to be implemented, and even though simulation of the system 
is generally necessary to evaluate its performance, many of the results discussed are 
useful in making intelligent decisions in the design process. A second, equally important, 
purpose of this part of the chapter was to illustrate a style of analysis that can be applied 
in studying quantization effects in a variety of digital signal-processing algorithms. The 
examples of the chapter indicate the types of assumptions and approximations that 
are commonly made in studying quantization effects. In Chapter 9 we will apply the 
analysis techniques developed here to the study of quantization in the computation of 
the discrete Fourier transform. 



Chap. 6 Problems 



419 



PROBLEMS 



Basic Problems with Answers 

6.1. Determine the system function of the two networks in Figure P6.1-1, and show that they 
have the same poles. 





-r sin 6 



Network 2 
(b) 



Figure P6.1-1 



6.2. The signal flow graph of Figure P6.2-1 represents a linear difference equation with constant 
coefficients. Determine the difference equation that relates the output y[n] to the input 
x[n]. 




Figure P6.2-1 
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6.3. Figure P6.3-1 shows six systems. Determine which one of the last five, (b)-(f), has the 
same system function as (a). You should be able to eliminate some of the possibilities by 
inspection. 




(a) 



O * Q- 
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J r , y[n] 



x[n] 
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(d) 



Figure P6.3-1 
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(e) 




(0 



Figure P6.3-1 {Continued) 



6.4. Consider the system in Figure P6.3-l(d). 

(a) Find the system function relating the z-transforms of the input and output. 

(b) Write the difference equation that is satisfied by the input sequence x[n] and the output 
sequence y[ri\. 

6.5. A linear time-invariant system is realized by the flow graph shown in Figure P6.5-1. 



x[n] 





y[n] 



Figure P6.5-1 

(a) Write the difference equation relating x[n] and y[n] for this flow graph. 

(b) What is the system function of the system? 

(c) In the realization of Figure P6.5-1, how many real multiplications and real additions 
are required to compute each sample of the output? (Assume that x[n] is real, and 
assume that multiplication by 1 does not count in the total.) 

(d) The realization of Figure P6.5-1 requires four storage registers (delay elements). Is it 
possible to reduce the number of storage registers by using a different structure? If 
so, draw the flow graph; if not, explain why the number of storage registers cannot be 
reduced. 



6.6. Determine the impulse response of each of the systems in Figure P6.6-1. 
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-»- Q 



x[n] 
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(a) 
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y[n) 
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,-i 



x[n] 



-1 



,4 



(b) 



(c) 




y[n] 




(d) 
Figure P6.6-1 

6.7. Let x[n] and _y[«] be Af-point sequences (N > 3) related by the following difference equa- 
tion: 

1 1 

y[n] - -y[n - 2] = x[n - 2] - -x[n]. 

Draw a direct form II signal flow graph for the causal LTI system corresponding to this 
difference equation. 
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6.8. The signal flow graph in Figure P6.8-1 represents an LTI system. Determine a difference 
equation that gives a relationship between the input x[n] and the output y[n] of this system. 
As usual, all branches of the signal flow graph have unity gain unless specifically indicated 
otherwise. 




Figure P6.8-1 

6.9. Figure P6.9-1 shows the signal flow graph for a causal discrete-time LTI system. Branches 
without gains explicitly indicated have a gain of unity. 

(a) Determine h[l], the impulse response at n = 1. 

(b) Determine the difference equation relating x[n] and y[ri\. 



x[n] 



"^ 



-1 

-« o- 
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-* o 



y[n] 



,r z 



-1 



Figure P6.9-1 



6.10. Consider the signal flow graph shown in Figure P6.10-1. 

(a) Using the node variables indicated, write the set of difference equations represented 
by this network. 

(b) Draw the flow graph of an equivalent system that is the cascade of two first-order 
systems. 

(c) Is the system stable? Explain. 



o — 
x[n) 



o *- 



nZ" 



v[n] 



nZ~ l 1 

2 

— <- 



y[n] 



W W Figure P6.10-1 

6.11. Consider a causal LTI system S with impulse response h[n] and system function 

(l-2z- 1 )(l-4z- 1 ) 



H{z) = 



*(l-i*-*) 



(a) Draw a direct form II flow graph for the system S. 

(b) Draw the transposed form of the flow graph in Part (a). 
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6.12. For the linear time-invariant system described by the flow graph in Figure P6.12-1, deter- 
mine the difference equation relating the input x[n] to the output y[n]. 




Figure P6.12-1 

6.13. Draw the signal flow graph for the direct form I implementation of the LTI system with 
system function 



H(z) = 



i - u- 2 



1 _ I 7 -l _ I 7 -2 



6.14. Draw the signal flow graph for the direct form II implementation of the LTI system with 
system function 

6.15. Draw the signal flow graph for the transposed direct form II implementation of the LTI sys- 
tem with system function 



H(z) = 



l + ^ + Jz" 2 



6.16. Consider the signal flow graph shown in Figure P6.16-1. 

(a) Draw the signal flow graph that results from applying the transposition theorem to this 
signal flow graph. 

(b) Confirm that the transposed signal flow graph that you found in (a) has the same system 
function H(Z) as the original system in the figure. 




Figure P6.16-1 



6.17. Consider the causal LTI system with system function 



(a) Draw the signal flow graph for the direct form implementation of this system, 

(b) Draw the signal flow graph for the transposed direct form implementation of the system. 
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6.18. For some choices of the parameters, the signal flow graph in Figure P6.18-1 can be replaced 
by a second-order direct form II signal flow graph implementing the same system function. 
Give one such choice for a and the system function H(z) that results. 




3 8 

6.19. Consider the causal LTI system with the system function 

H{z) = 



Figure P6.18-1 



2-\z-^2z- 2 



(i-iz-i) (! + §;-')■ 

Draw a signal flow graph that implements this system as a parallel combination of first-order 
transposed direct form II sections. 

6.20. Draw a signal flow graph implementing the system function 

H( 7 \ = (l + (l-7/2)z- 1 )(l + (1 + 7/2)^) 

K} (1 + 072)z- l )(l - (7/2)z-i)(l - (l/2)z-i)(l - 2Z- 1 ) 
as a cascade of second-order transposed direct form II sections with real coefficients. 



Basic Problems 



6.21. For many applications, it is useful to have a system that will generate a sinusoidal sequence. 
One possible way to do this is with a system whose impulse response is h[n] = e^ on u[n]. 
The real and imaginary parts of h[n] are therefore h r [n] = (cos a)on)u[n] and hi[n] = 
(sin coq n)u[n], respectively. 

In implementing a system with a complex impulse response, the real and imaginary 
parts are distinguished as separate outputs. By first writing the complex difference equation 
required to produce the desired impulse response and then separating it into its real and 
imaginary parts, draw a flow graph that will implement this system. The flow graph that you 
draw can have only real coefficients. This implementation is sometimes called the coupled 
form oscillator, since, when the input is excited by an impulse, the outputs are sinusoidal. 

6.22. For the system function 



H(z) = 



l+2z~ 1 +z~ 2 

l-iz-l + iz-2' 



draw the flow graphs of all possible realizations for this system as cascades of first-order 
systems. 

6.23. Consider a causal linear time-invariant system whose system function is 



H(z) = 



1-5* 



1 .-1 



(1 - .,-. + i z -2) (1 + .<-,) 
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(a) Draw the signal flow graphs for implementations of the system in each of the following 
forms: 

(i) Direct form I 
(ii) Direct form II 

(iii) Cascade form using first- and second-order direct form II sections 
(iv) Parallel form using first- and second-order direct form II sections 
(v) Transposed direct form II 

(b) Write the difference equations for the flow graph of (v) in Part (a), and show that this 
system has the correct system function. 

6.24. Several flow graphs are shown in Figure P6.24-1. Determine the transpose of each flow 
graph, and verify that in each case the original and transposed flow graphs have the same 
system function. 




x[n] 



y[*\ 



(a) 




(b) 




(c) 




-r sin 6 



" rs'm& 



y[»] 



(d) 



Figure P6.24-1 
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6.25, Consider the system in Figure P6.25-1. 




Figure P6.25-1 

(a) Find the system function relating the ^-transforms of the input and output. 

(b) Write the difference equation that is satisfied by the input sequence x[n] and the output 
sequence y[n]. 

(c) Draw a signal flow graph that has the same input-output relationship as the system in 
Figure P6.25-1, but that has the smallest possible number of delay elements. 

6.26. A linear time-invariant system with system function 

„,* = 0-2(1 + ^')" 

K> (1 - 2 Z -1 + |z"2) (1 + Z- 1 + i Z - 2 ) (1 - i Z - ] + Z" 2 ) 

is to be implemented using a flow graph of the form shown in Figure P6.26-1. 
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Figure P6.26-1 

(a) Fill in all the coefficients in the diagram of Figure P6.26-1. Is your solution unique? 

(b) Define appropriate node variables in Figure P6.26-1, and write the set of difference 
equations that is represented by the flow graph. 

Advanced Problems 



6.27. Consider a general flow graph (denoted network A) consisting of coefficient multipliers 
and delay elements, as shown in Figure P6.27-1. If the system is initially at rest, its behavior 
is completely specified by its impulse response h[ri]. We wish to modify the system to create 
a new flow graph (denoted network A\) with impulse response hi[n] = (— l)"h[n]. 
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Network A 



Figure P6.27-1 



(a) If H(e jco ) is as given in Figure P6.27-2, sketch H { {e jm ). 



H(ei") 




Figure P6.27-2 



(b) Explain how to modify network A by simple modifications of its coefficient multipliers 
and/or the delay branches to form the new network A\ whose impulse response is 
hi[n]. 

(c) If network Ais as given in Figure P6.27-3, show how to modify it by simple modifications 
to only the coefficient multipliers so that the resulting network A\ has impulse response 
hi[n]. 
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Figure P6.27-3 



6.28. The flow graph shown in Figure P6.28-1 is noncompu table; i.e., it is not possible to compute 
the output using the difference equations represented by the flow graph because it contains 
a closed loop having no delay elements. 
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Figure P6.28-1 

(a) Write the difference equations for the system of Figure P6.28-1, and from them, find 
the system function of the network. 

(b) From the system function, obtain a flow graph that is computable. 

6.29. The impulse response of a linear time-invariant system is 



h r n i _ / ""' ° ^ " ^ 7 ' 
1 * JO, otherwise. 



(a) Draw the flow graph of a direct-form nonrecursive implementation of the system. 

(b) Show that the corresponding system function can be expressed as 

1 - a V 8 

H(z)=- V |z|>|«|. 

1 - az l 

(c) Draw the flow graph of an implementation of H(z), as expressed in Part (b), corre- 
sponding to a cascade of an FIR system (numerator) with an IIR system (denominator). 

(d) Is the implementation in Part (c) recursive or nonrecursive? Is the overall system FIR 
or IIR? 

(e) Which implementation of the system requires 
(i) the most storage (delay elements)? 

(ii) the most arithmetic (multiplications and additions per output sample)? 

6.30. Consider an FIR system whose impulse response is 

£(1 + cos[(2w/15)(#i - n )]), < n < 14, 

otherwise. 



*]-{*' 



This system is an example of a class of filters known as frequency-sampling filters. Prob- 
lem 6.37 discusses these filters in detail. In this problem, we consider just one specific 
case. 

(a) Sketch the impulse response of the system for the cases no = and no = 15/2. 

(b) Show that the system function of the system can be expressed as 



//(*) = (! _;-'>). I 



-15> 
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lp-;'2nno/l5 
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1 j27ino/lS 
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15 [1-Z- 1 ' 1 - <?/2;r/15 z -l ' I _ e -jl« /IS z ~l 

(c) Show that if no = 15/2, the frequency response of the system can be expressed as 



15 [ sin 



<»15/2) 1 sin[(a> - 2jt/15)15/2] 



$in(a>/2) 2 sin[(<y - 2jt/15)/2] 

1 sin[(a> + 2jt/15)15/2] ) 

2 sin[(o> + 2jr/15)/2] J" 

Use this expression to sketch the magnitude of the frequency response of the system 
for no = 15/2, Obtain a similar expression for no = 0. Sketch the magnitude response 
for no = 0. For which choices of no does the system have a generalized linear phase? 
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(d) Draw a signal flow graph of an implementation of the system as a cascade of an FIR sys- 
tem whose system function is 1 — z~ 15 and a parallel combination of a first- and second- 
order IIR system. 

6.31. Consider the discrete-time system depicted in Figure P6.31-1. 



yd"] 




\-T 



Figure P6.31-1 



(a) Write the set of difference equations represented by the flow graph of Figure P6.31-1. 

(b) Determine the system function H\(z) = Y\(z)/X(z) of the system in Figure P6.31-2, 
and determine the magnitudes and angles of the poles of H\(z) as a function of r for 
-1 </■ <1. 

(c) Figure P6.31-2 shows a different flow graph obtained from the flow graph of Fig- 
ure P6.31-1 by moving the delay elements to the opposite top branch. How is the 
system function H 2 (z) = Y 2 (z)/X(z) related to Hi(z)? 




1-r 



Figure P6.31-2 



6.32. The three networks in Figure P6.32-1 are all equivalent implementations of the same two- 
input, two-output linear time-invariant system. 
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Figure P6.32-1 
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(a) Write the difference equations for network A. 

(b) Find values ofa,b, c, and d for network B in terms of r in network ,4 such that the two 
systems are equivalent. 

(c) Find values of e and / for network C in terms of r in network A such that the two 
systems are equivalent. 

(d) Why might network B or C be preferred over network A? What possible advantage 
could network A have over network B or C? 

6.33. Consider an all-pass system with system function 



H{z) = 



z~ l - 0.54 



1 - 0.54*- 1 ' 
A flow graph for an implementation of this system is shown in Figure P6.33-1. 




Figure P6.33-1 

(a) Determine the coefficients b, c, and d such that the flow graph in Figure P6.33-1 is a 
realization of H(z). 

(b) In a practical implementation of the network in Figure P6.33-1, the coefficients b, c, 
and d might be quantized by rounding the exact value to the nearest tenth (e.g., 0.54 
will be rounded to 0.5 and 1.8518. . .will be rounded to 1.9). Would the resulting system 
still be an all-pass system? 

The difference equation relating the input and output of the all-pass system with 
system function H(z) can be expressed as 

y[n] = 0.54(v[« - 1] - x[n]) + x[n - 1]. 

(c) Draw the flow graph of a network that implements this difference equation using two 
delay elements, but that requires only one multiplication by a constant other than ±1. 

(d) With quantized coefficients, would the network of part (c) be an all-pass system? 

The primary disadvantage of the implementation in part (c) compared with the im- 
plementation in part (a) is that it requires two delay elements. However, for higher order 
systems, it is necessary to implement a cascade of all-pass systems. For N all-pass sections 
in cascade, it is possible to use all-pass sections in the form determined in Part (c) while 
requiring only (N + 1) delay elements. This is accomplished by sharing a delay element 
between sections. 

(e) Consider the all-pass system with system function 

, z~ l -a \ ( z~ l -b 



l-az' x ) \1 -bz~ l 

Draw the flow graph of a "cascade" realization composed of two sections of the form 
obtained in Part (c) with one delay element shared between the sections. The resulting 
network should have only three delay elements. 
(f) With quantized coefficients a and b, would the network in Part (e) be an all-pass system? 

6.34. All branches of the signal flow graphs in this problem have unity gain unless specifically 
indicated otherwise. 
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Figure P6.34-1 

(a) The signal flow graph of System A, shown in Figure P6.34-1, represents a causal LTI sys- 
tem. Is it possible to implement the same input-output relationship using fewer delays? 
If it is possible, what is the minimum number of delays required to implement an 
equivalent system? If it is not possible, explain why not. 

(b) Does the System B shown in Figure P6.34-2 represent the same input-output relation- 
ship as System Am Figure P6.34-1? Explain clearly. 




6.35. Consider an all-pass system whose system function is 



H(z) = 



1 - Jz-i 



Figure P6.34-2 



(a) Draw the direct form I signal flow graph for the system. How many delays and multi- 
pliers do you need? (Do not count multiplying by ±1.) 

(b) Draw a signal flow graph for the system that uses one multiplier. Minimize the number 
of delays. 

(c) Now consider another all-pass system whose system function is 



H(z) = 



{z-'-\){z~'-2) 
(1-1Z-1X1-2Z- 1 ) 



Find and draw a signal flow graph for the system with two multipliers and three delays. 
636. The flow graph shown in Figure P6.36-1 is an implementation of a causal, LTI system. 




Figure P6.36-1 

(a) Draw the transpose of the signal flow graph. 

(b) For either the original system or its transpose, determine the difference equation relat- 
ing the input x[n] to the output y[n], (Note: The difference equations will be the same 
for both structures.) 

(c) Is the system BIBO stable? 

(d) Determine y[2] ifx[n] = (l/2)"u[n]. 
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Extension Problems 

6.37. In this problem, we will develop some of the properties of a class of discrete-time systems 
called frequency-sampling filters. This class of filters has system functions of the form 

where z k = e ^ 2jr ^ k for k = 0, 1, . . . , N - 1. 

(a) System functions such as H(z) can be implemented as a cascade of an FIR system whose 
system function is (1 — z~ N ) with a parallel combination of first-order IIR systems. Draw 
the signal flow graph of such an implementation. 

(b) Show that H(z) is an (N — l)st-degree polynomial in z~ x . To do this, it is necessary to 
show that H(z) has no poles other than z = and that it has no powers of z~ l higher 
than (N — 1). What do these conditions imply about the length of the impulse response 
of the system? 

(c) Show that the impulse response is given by the expression 

h[n] = (jjJ2 H[k]e S{27T!N)kn j (u[n] - u[n - N]). 

Hint: Find the impulse responses of the FIR and the IIR parts of the system, and 
convolve them to find the overall impulse response. 

(d) Use THopital's rule to show that 

H{z m ) = //(e /{2jr/yv)m ) = H[m], m = 0,l iV-1; 

i.e., show that the constants H[m] are samples of the frequency response of the system, 
H(e^), at equally spaced frequencies co m = (2jz/N)mform = 0, 1, . . . , N— 1. It is this 
property that accounts for the name of this class of FIR systems. 

(e) In general, both the poles Zk of the IIR part and the samples of the frequency response 
H[k] will be complex. However, if h[n] is real, we can find an implementation involving 
only real quantities. Specifically, show that if h[n] is real and N is an even integer, then 
H(z) can be expressed as 

m\ n -nJ H(1)/N , H(-l)/N 

H(z) = (1 - Z )< rf + t , _x 

[ 1 - z l 1 + z 1 

( Y^" 1 2\H(e^ 2n/N)k )\ cos[0(2jtk/N)] - z~ x cos[0(2jtk/N) - 2jtk/N] 1 
+ JT[ ^ l-2cos(2nk/N)z- l +z' 2 J' 

where H(e^) = |//(e /w )|e /l9 ^. Draw the signal flow graph representation of such a 
system when TV = 16 and H(e^ k ) = for k = 3, 4 14. 

6.38. In Chapter 4, we showed that, in general, the sampling rate of a discrete-time signal can be 
reduced by a combination of linear filtering and time compression. Figure P6.38-1 shows 
a block diagram of an M-to-1 decimator that can be used to reduce the sampling rate by 
an integer factor M. According to the model, the linear filter operates at the high sampling 
rate. However, if M is large, most of the output samples of the filter will be discarded by 
the compressor. In some cases, more efficient implementations are possible. 



x[n] 



H(z) 
h[n\ 



w[n] 



\M 



y[n] = w [Mn] Figure P6.38-1 
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(a) Assume that the filter is an FIR system with impulse response such that h[n] = for 
n < and for n > 10. Draw the system in Figure P6.38-1, but replace the filter h[n] 
with an equivalent signal flow graph based on the given information. Note that it is not 
possible to implement the M-to-1 compressor using a signal flow graph, so you must 
leave this as a box, as shown in Figure P6.38-1. 

Note that some of the branch operations can be commuted with the compression 
operation. Using this fact, draw the flow graph of a more efficient realization of the 
system of Part (a). By what factor has the total number of computations required in 
obtaining the output y[n] been decreased? 

(c) Now suppose that the filter in Figure P6.38-1 has system function 



(b) 



H(z) = 



1 



1-Iz-i' 



>!■ 



Draw the flow graph of the direct-form realization of the complete system in the figure. 
With this system for the linear filter, can the total computation per output sample be 
reduced? If so, by what factor? 
(d) Finally, suppose that the filter in Figure P6.38-1 has system function 

H(z) = ^4^-, \z\ 



1-ir 



>l 



Draw the flow graph for the complete system of the figure, using each of the following 
forms for the linear filter: 

(i) direct form I 

(ii) direct form II 
(iii) transposed direct form I 
(iv) transposed direct form II 

For which of the four forms can the system of Figure P6.38-1 be more efficiently im- 
plemented by commuting operations with the compressor? 

6.39. Speech production can be modeled by a linear system representing the vocal cavity, which is 
excited by puffs of air released through the vibrating vocal cords. One approach to synthe- 
sizing speech involves representing the vocal cavity as a connection of cylindrical acoustic 
tubes of equal length, but with varying cross-sectional areas, as depicted in Figure P6.39-1. 
Let us assume that we want to simulate this system in terms of the volume velocity repre- 
senting airflow. The input is coupled into the vocal tract through a small constriction, the 
vocal cords. We will assume that the input is represented by a change in volume velocity 
at the left end, but that the boundary condition for traveling waves at the left end is that 
the net volume velocity must be zero. This is analogous to an electrical transmission line 
driven by a current source at one end and with an open circuit at the far end. Current in the 
transmission line is then analogous to volume velocity in the acoustic tube, while voltage 
is analogous to acoustic pressure. The output of the acoustic tube is the volume velocity at 
the right end. We assume that each section is a lossless acoustic transmission line. 
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Figure P6.39-1 
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At each interface between sections, a forward-traveling wave / + is transmitted to the next 
section with one coefficient and reflected as a backward-traveling wave /" with a different 
coefficient. Similarly, a backward-traveling wave /~ arriving at an interface is transmitted 
with one coefficient and reflected with a different coefficient. Specifically, if we consider a 
forward-traveling wave /+ in a tube with cross-sectional area A\ arriving at the interface 
with a tube of cross-sectional area A2, then the forward-traveling wave transmitted is 
(1 + r)f + and the reflected wave is rf + , where 



r — 



A 2 



Aj + Ai 



Consider the length of each section to be 3.4 cm, with the velocity of sound in air equal to 
34,000 cm/s. Draw a flow graph that will implement the four-section model in Figure P6.39-1 , 
with the output sampled at 20,000 samples/s. 

In spite of the lengthy introduction, this a reasonably straightforward problem. If 
you find it difficult to think in terms of acoustic tubes, think in terms of transmission-line 
sections with different characteristic impedances. Just as with transmission lines, it is difficult 
to express the impulse response in closed form. Therefore, draw the network directly from 
physical considerations, in terms of forward- and backward-traveling pulses in each section. 

6.40. In modeling the effects of round-off and truncation in digital filter implementations, quan- 
tized variables are represented as 

x[n] = Q[x[n\] = x[n] + e[n] t 

where Q[] denotes either rounding or truncation to (B+ 1) bits and e[ri\ is the quantization 
error. We assume that the quantization noise sequence is a stationary white-noise sequence 
such that 

£{(e[«] - m e )(e[n + m] - m e )} — aj 8[m] 

and that the amplitudes of the noise sequence values are uniformly distributed over the 
quantization step A = 2~ B . The first-order probability densities for rounding and truncation 
are shown in Figures P6.40-l(a) and (b), respectively. 
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Figure P6.40-1 

(a) Find the mean m e and the variance o^ for the noise due to rounding. 

(b) Find the mean m e and the variance a} for the noise due to truncation. 

6.41. Consider a linear time-invariant system with two inputs, as depicted in Figure P6.41-1. Let 
h\\n] and ti2[n] be the impulse responses from nodes 1 and 2, respectively, to the output, 
node 3. Show that if x\[n] and X2[n] are uncorrected, then their corresponding outputs 
yi [n] and yi[n\ are also uncorrelated. 
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x 2 [n] 



y[n]=yi[n] + y 2 [n] 



Figure P6.41-1 



6.42. The networks in Figure P6.42-1 all have the same system function. Assume that the systems 
in the figure are implemented using (B 4- l)-bit fixed-point arithmetic in all the compu- 
tations. Assume also that all products are rounded to (B + 1) bits before additions are 
performed. 





(a) 



(b) 



x[n] 





y[n] 



(c) 

Figure P6.42-1 

(a) Draw linear-noise models for each of the systems in Figure P6.42-1. 

(b) Two of the networks in Figure P6.42-1 have the same total output noise power due to 
arithmetic round-off. Without explicitly computing the output noise power, determine 
which two have the same output noise power. 

(c) Determine the output noise power for each of the networks in Figure P6.42-1. Express 
your answer in terms of a\, the power of a single source of round-off noise. 

6.43. The flow graph of a first-order system is shown in Figure P6.43-1. 




4 —a Figure P6.43-1 

(a) Assuming infinite-precision arithmetic, find the response of the system to the input 



x[n] = 



0, n < 0. 



What is the response of the system for large nl 
Now suppose that the system is implemented with fixed-point arithmetic. The coeffi- 
cient and all variables in the network are represented in sign-and-magnitude notation with 
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5-bit registers. That is, all numbers are to be considered signed fractions represented as 

where £>o, b\, b2, 63, and 64 are either or 1 and 

I Register value | = b\T x + b 2 2~ 2 + £ 3 2~ 3 + b 4 2~ 4 . 

If bo = 0, the fraction is positive, and if bo = 1, the fraction is negative. The result of a 
multiplication of a sequence value by a coefficient is truncated before additions occur; i.e., 
only the sign bit and the most significant four bits are retained. 

(b) Compute the response of the quantized system to the input of Part (a), and plot the 
responses of both the quantized and unquantized systems for < n < 5. How do the 
responses compare for large nl 

(c) Now consider the system depicted in Figure P6.43-2, where 



Repeat Parts (a) and (b) for this system and input. 



|(-l) rt , «>0, 
n <0. 




6.44. A causal LTI system has a system function 



Figure P6.43-2 



1-1.042-!+ 0.98z- 2 ' 

(a) Is this system stable? 

(b) If the coefficients are rounded to the nearest tenth, would the resulting system be 
stable? 

6.45. When implemented with infinite-precision arithmetic, the flow graphs in Figure P6.45-1 
have the same system function. 




Network 1 



x[n] 



-1 
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<? *- 
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Network 2 
Figure P6.45-1 



_o 



y[n) 



(a) Show that the two systems have the same overall system function from input x[n] to 
output y[n]. 

(b) Assume that the preceding systems are implemented with two's complement fixed- 
point arithmetic and that products are rounded before additions are performed. Draw 
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signal flow graphs that insert round-off noise sources at appropriate locations in the 
signal flow graphs of Figure P6.45-1. 

(c) Circle the nodes in your figure from Part (b) where overflow can occur. 

(d) Determine the maximum size of the input samples such that overflow cannot occur in 
either of the two systems. 

(e) Assume that \a\ < 1. Find the total noise power at the output of each system, and 
determine the maximum value of \a | such that Network 1 has lower output noise power 
than Network 2. 
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The discrete fourier 
transform 



8.0 INTRODUCTION 

In Chapters 2 and 3 we discussed the representation of sequences and linear time- 
invariant systems in terms of the Fourier and z-transforms, respectively. For finite- 
duration sequences, it is possible to develop an alternative Fourier representation, 
referred to as the discrete Fourier transform (DFT). The DFT is itself a sequence rather 
than a function of a continuous variable, and it corresponds to samples, equally spaced 
in frequency, of the Fourier transform of the signal. In addition to its theoretical im- 
portance as a Fourier representation of sequences, the DFT plays a central role in 
the implementation of a variety of digital signal-processing algorithms. This is because 
efficient algorithms exist for the computation of the DFT. These algorithms will be 
discussed in detail in Chapter 9. The application of the DFT to spectral analysis will be 
described in Chapter 10. 

Although several points of view can be taken toward the derivation and inter- 
pretation of the DFT representation of a finite-duration sequence, we have chosen to 
base our presentation on the relationship between periodic sequences and finite-length 
sequences. We will begin by considering the Fourier series representation of periodic 
sequences. While this representation is important in its own right, we are most often in- 
terested in the application of Fourier series results to the representation of finite-length 
sequences. We accomplish this by constructing a periodic sequence for which each period 
is identical to the finite-length sequence. As we will see, the Fourier series representation 
of the periodic sequence corresponds to the DFT of the finite-length sequence. Thus, 
our approach is to define the Fourier series representation for periodic sequences and to 
study the properties of such representations. Then we repeat essentially the same deriva- 
tions, assuming that the sequence to be represented is a finite-length sequence. This 
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approach to the DFT emphasizes the fundamental inherent periodicity of the DFT 
representation and ensures that this periodicity is not overlooked in applications of the 
DFT. 

8.1 REPRESENTATION OF PERIODIC SEQUENCES: 
THE DISCRETE FOURIER SERIES 

Consider a sequence x[n] that is periodic 1 with period N, so that x[n] = x[n + rN] for 
any integer values of n and r. As with continuous-time periodic signals, such a sequence 
can be represented by a Fourier series corresponding to a sum of harmonically related 
complex exponential sequences, i.e., complex exponentials with frequencies that are 
integer multiples of the fundamental frequency (Itz/N) associated with the periodic 
sequence x[n\. These periodic complex exponentials are of the form 

e k [n] = e ii2nlN)kn = e k [n + rN\ (8.1) 

where k is an integer, and the Fourier series representation then has the form 2 

x[n] = ~Y1 X[k]e H2 * /N)k "- ( 8 - 2 ) 

k 

The Fourier series representation of a continuous-time periodic signal gener- 
ally requires infinitely many harmonically related complex exponentials, whereas the 
Fourier series for any discrete-time signal with period N requires only N harmonically 
related complex exponentials. To see this, note that the harmonically related com- 
plex exponentials e k [n] in Eq. (8.1) are identical for values of k separated by /V; i.e., 
€o[n] = ^[^1, ^i [n] = ?n+\ [«], arid, in general, 

e k+tN [n] = eWM+W = e j{2n/N)kn e j2ne " = e i{27T/N)k " = **[«], (8.3) 

where I is an integer. Consequently, the set of N periodic complex exponentials eo[n], 
e\ [«],... , ejv-i [«] defines all the distinct periodic complex exponentials with frequencies 
that are integer multiples of (Itz/N). Thus, the Fourier series representation of a periodic 
sequence x[n] need contain only N of these complex exponentials, and hence, it has the 
form 

1 N ~ l 
x[n] = - ^ X[k]e i{2n/N)kn . (8.4) 

k=0 

To obtain the sequence of Fourier series coefficients X[k] from the periodic se- 
quence x[n], we exploit the orthogonality of the set of complex exponential sequences. 
After multiplying both sides of Eq. (8.4) by e~ }( - 2nlN)rn and summing from n = to 
n — N — 1, we obtain 

]T x[n]e-K 2jr W rn = E - E X[k]e K2jr/N * k - r)n . (8.5) 

/i=0 /i=0 A;=0 

henceforth, we will use the tilde (~) to denote periodic sequences whenever it is important to clearly 
distinguish between periodic and aperiodic sequences. 

2 The multiplicative constant 1//V is included in Eq. (8.2) for convenience. It could also be absorbed 
into the definition of X[k]. 



Sec. 8.1 Representation of Periodic Sequences: The Discrete Fourier Series 543 

After interchanging the order of summation on the right-hand side, we see that Eq. (8.5) 
becomes 



N-\ 

:/N)(k-r)n 

N 



1 /V-J 



n=0 



(8.6) 



N-\ N-\ 

Y x[n]e-H 2jr/N)rn = Y XW 

h=0 A-=0 

The following identity expresses the orthogonality of the complex exponentials: 

}_Ye ii27T/N)ik - r) " = I lf k ~ r=mN < ™ an integer, 
N ^ 1 0, otherwise. 

;/=o v 

This identity can easily be proved (see Problem 8.51), and when it is applied to the 

summation in brackets in Eq. (8.6), the result is 

N-\ 

Y x[n]e~ i{2n/N)ni = X[r]. (8.8) 

Thus, the Fourier series coefficients X[k] in Eq. (8.4) are obtained from x[n] by the 
relation 

N-\ 

X[k] = Y x[n]e-i {2jr/N)k ". (8.9) 

Note that the sequence X[k] is periodic with period N\ i.e., X[Q] = ^[N], X[l] = 
X[N +1], and, more generally, 

X[k + N] = Yx[n]e- J < 2 "' N) < k+N) " 

= (Y^xi n ] e ~ j{2jT/N)k " ) e v2jT " = xw 

for any integer k. 

The Fourier series coefficients can be interpreted to be a sequence of finite length, 

given by Eq. (8.9) for k = 0, ( N — 1), and zero otherwise, or as a periodic sequence 

defined for all k by Eq. (8.9). Clearly, both of these interpretations are acceptable, since 
in Eq. (8.4) we use only the values of X[k] for < k < (N — 1). An advantage of inter- 
preting the Fourier series coefficients X[k] as a periodic sequence is that there is then a 
duality between the time and frequency domains for the Fourier series representation 
of periodic sequences. Equations (8.9) and (8.4) together are an analysis-synthesis pair 
and will be referred to as the discrete Fourier series (DFS) representation of a periodic 
sequence. For convenience in notation, these equations are often written in terms of 
the complex quantity 

W N = e-v( 2 ^ v >. (8.10) 

With this notation, the DFS analysis-synthesis pair is expressed as follows: 

Analysis equation: X[k] = ^2x[n]W k / t . (8.11) 

n=0 



, JV-l 

Synthesis equation: x[n] = — Y ^W^ n - ( 8 - 12 ) 



Jt=0 
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In both of these equations, X[k] and x[n] are periodic sequences. We will sometimes 
find it convenient to use the notation 

x[n] £S X[k] (8.13) 

to signify the relationships of Eqs. (8.11) and (8.12). The following examples illustrate 
the use of those equations. 

Example 8.1 Discrete Fourier Series of a Periodic 
Impulse Train 

We consider the periodic impulse train 

-r i V^ c r »,i f 1< n — rN, r any integer, ,oia\ 

x[n]= > S[n-rN] = < J & (8.14) 

1 J ^— t J I 0, otherwise. 



r = ~ oc 



Since x[n] = S[n] for < n < N — 1, the DFS coefficients are found, using Eq. (8.11), 
to be 

X[k] = ^2&[n]Wh" = W^ = 1. (8.15) 

In this case, X[k] is the same for all k. Thus, substituting Eq. (8.15) into Eq. (8.12) 
leads to the representation 

N~l . N-\ 



r= oc Ar=0 A:=() 

(Note the similarity to the orthogonality relation of Eq. (8.7).) 



Example 8.1 produced a useful representation of a periodic impulse train in terms 
of a sum of complex exponentials, where all the complex exponentials have the same 
magnitude and phase and add to unity at integer multiples of N and to zero for all other 
integers. If we look closely at Eqs. (8.11) and (8.12), we see that the two equations are 
very similar, differing only in a constant multiplier and the sign of the exponents. This 
duality between the periodic sequence x[n\ and its discrete Fourier series coefficients 
X[k] is illustrated in the following example. 

Example 8.2 Duality in the Discrete Fourier Series 

Here we let the discrete Fourier series coefficients be the periodic impulse train 

DC 

Y[k] = Y^ N8[k-rN]. 

r=—oc 

Substituting Y[k] into Eq. (8.12) gives 



y[n] = ^J2 m W 



-kn 



k=0 



In this case, y[n] = 1 for all n. Comparing this result with the results for x[n] and X[k] 
of Example 8.1, we see that Y[k] — Nx[k] and y[n] — X[n]. In Section 8.2.3, we will 
show that this example is a special case of a more general duality property. 
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If the sequence x[n] is equal to unity over only part of one period, we can also ob- 
tain a closed-form expression for the DFS coefficients. This is illustrated by the following 
example. 

Example 8.3 The Discrete Fourier Series of a Periodic 
Rectangular Pulse Train 

For this example, x[n] is the sequence shown in Figure 8.1, whose period is N = 10. 



x[r,} 



ft? 



T T T 



-10 



1 2 3 4 5 6 7 8 9 10 



Figure 8.1 Periodic sequence with period N = 10 for which the Fourier series 
representation is to be computed. 



From Eq. (8.11), 



x[k\ = J2 K" = Y, e ~ ji27T/im "- 



(8.17) 



n=0 



n=() 



This finite sum has the closed form 



r5k 



X[k] 



= 1-WJo =c -j '(Win) sinW2) 



1 - W k 

1 vv \o 



sin(xk/lQ) 
The magnitude and phase of the periodic sequence X[k\ are shown in Figure 8.2 

X[k]\ 



(8.18) 
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x denotes indeterminate < 
(magnitude = 0) 



(b) 

Figure 8.2 Magnitude and phase of the Fourier series coefficients of the sequence 
of Figure 8.1. 
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We have shown that any periodic sequence can be represented as a sum of complex 
exponential sequences. The key results are summarized in Eqs. (8.11) and (8.12). As we 
will see, these relationships are the basis for the DFT, which focuses on finite-length 
sequences. Before discussing the DFT, however, we will consider some of the basic 
properties of the DFS representation of periodic sequences, and then we will show how 
we can use the DFS representation to obtain a Fourier transform representation of 
periodic signals. 



8.2 PROPERTIES OF THE DISCRETE FOURIER SERIES 

Just as with Fourier series and Fourier and Laplace transforms for continuous-time 
signals, and with z-transforms for discrete-time aperiodic sequences, certain properties 
of discrete Fourier series are of fundamental importance to its successful use in signal- 
processing problems. In this section, we summarize these important properties. It is 
not surprising that many of the basic properties are analogous to properties of the 
z-transform and Fourier transform. However, we will be careful to point out where the 
periodicity of both x[n] and X[k] results in some important distinctions. Furthermore, an 
exact duality exists between the time and frequency domains in the DFS representation 
that does not exist in the Fourier transform and z-transform representation of sequences. 

8.2.1 Linearity 

Consider two periodic sequences x\[n] and x 2 [n], both with period jV, such that 



and 
Then 



xi[n] £S X t [k] (8.19a) 

x 2 [n] £S X 2 [k] (8.19b) 

a~x { [n] + bx 2 [n] <^ aX x [k] + bX 2 [k]. (8.20) 



This linearity property follows immediately from the form of Eqs. (8.11) and (8.12). 

8.2.2 Shift of a Sequence 

If a periodic sequence x[n] has Fourier coefficients X[k], then x[n — m] is a shifted 
version of x[n], and 

x[n - m] £S W k N m X[k\. (8.21) 

The proof of this property is considered in Problem 8.52. Any shift that is greater 
than or equal to the period (i.e., m > N) cannot be distinguished in the time domain 
from a shorter shift m\ such that m = m\ + m 2 N, where mi and m 2 are integers 
and < m\ < N — 1. (Another way of stating this is that m\ = m modulo N or, 
equivalently, m\ is the remainder when m is divided by N.) It is easily shown that with 
this representation of m, W^ m = W^J" 1 ; i.e., as it must be, the ambiguity of the shift in 
the time domain is also manifest in the frequency- domain representation. 
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Because the sequence of Fourier series coefficients of a periodic sequence is a 
periodic sequence, a similar result applies to a shift in the Fourier coefficients by an 
integer L Specifically, 

W N ni x[n] SS X[k - I]. (8.22) 

Note the difference in the sign of the exponents in Eqs. (8.21) and (8.22). 

8.2.3 Duality 

Because of the strong similarity between the Fourier analysis and synthesis equations 
in continuous time, there is a duality between the time domain and frequency domain. 
However, for the discrete-time Fourier transform of aperiodic signals, no similar duality 
exists, since aperiodic signals and their Fourier transforms are very different kinds of 
functions: Aperiodic discrete-time signals are, of course, aperiodic sequences, while their 
Fourier transforms are always periodic functions of a continuous frequency variable. 

From Eqs. (8.11) and (8.12), we see that the DFS analysis and synthesis equations 
differ only in a factor of \/N and in the sign of the exponent of W N . Furthermore, a 
periodic sequence and its DFS coefficients are the same kinds of functions; they are both 
periodic sequences. Specifically, taking account of the factor \/N and the difference in 
sign in the exponent between Eqs. (8.11) and (8.12), it follows from Eq. (8.12) that 

Nx[-n] = J2 *[*]**#' (8.23) 

*=o 

or, interchanging the roles of n and A: in Eq. (8.23), 

N-\ 

Nx[-k] = J2 X[ n ] w H k - ( 8 - 24 ) 

n=0 

We see that Eq. (8.24) is similar to Eq. (8.11). In other words, the sequence of DFS 
coefficients of the periodic sequence X[n] is Nx[—k], i.e., the original periodic sequence 
in reverse order and multiplied by N. This duality property is summarized as follows: 
If 



then 



x[n] ^ X[k], (8.25a) 



X[n] 2S Nx[-k]. (8.25b) 



8.2.4 Symmetry Properties 

As we discussed in Section 2.8, the Fourier transform of an aperiodic sequence has 
a number of useful symmetry properties. The same basic properties also hold for the 
DFS representation of a periodic sequence. The derivation of these properties, which is 
similar in style to the derivations in Chapter 2, is left as an exercise. (See Problem 8.53.) 
The resulting properties are summarized for reference as properties 9-17 in Table 8.1 
in Section 8.2.6. 
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8.2.5 Periodic Convolution 

Let xi[n] and x 2 [n] be two periodic sequences, each with period TV and with discrete 
Fourier series coefficients denoted by X\[k\ and X?[^L respectively. If we form the 
product 

Xs[k\ = X![k\X 2 [kl (8.26) 

then the periodic sequence x^n] with Fourier series coefficients Xs[k] is 

N-l 

xi,[n] = 2_] X[[m]x 2 [n — m]. (8.27) 

This result is not surprising, since our previous experience with transforms suggests 
that multiplication of frequency-domain functions corresponds to convolution of time- 
domain functions and Eq. (8.27) looks very much like a convolution sum. Equa- 
tion (8.27) involves the summation of values of the product of x\ [m] with x 2 [n — m] , which 
is a time-reversed and time-shifted version of .^[m], just as in aperiodic discrete con- 
volution. However, the sequences in Eq. (8.27) are all periodic with period N, and the 
summation is over only one period. A convolution in the form of Eq. (8.27) is referred 
to as aperiodic convolution. Just as with aperiodic convolution, periodic convolution is 
commutative; i.e., 

N-l 

xi[n] = V^ jc 2 M^i[« — >"]. (8.28) 

To demonstrate that ^[/c], given by Eq. (8.26), is the sequence of Fourier coef- 
ficients corresponding to x 3 [n] given by Eq. (8.27), let us first apply the DFS analysis 
equation (8.11) to Eq. (8.27) to obtain 

N-l /N-l \ 

XsW = H[lL jtl M*2[rt - m l W N< ( 8 - 29 ) 

n=Q \m=0 / 

which, after we interchange the order of summation, becomes 

N-l /N-l \ 

x 3 [k] = Yl ^m [Y,^ n - m ^ w N n • ( 8 - 3 °) 

m=0 \n=0 / 

The inner sum on the index n is the DFS for the shifted sequence x 2 [n — m]. Therefore, 
from the shifting property of Section 8.2.2, we obtain 

n-i 

Y J Hn-m]W k N n = W k N m X 1 [kl 

which can be substituted into Eq. (8.30) to yield 

N-l /N-l \ 

X 3 [k] = ^i 1 H^ w J 2 [fc] = ^xiMWj m X 2 [k] = Xi[k]X 2 [k]. (8.31) 

m=0 \m=0 / 

In summary, 

N-l 

Y, xi [m]x 2 [n - m] £S Xi [k]X 2 [k]. (8.32) 

m=0 
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The periodic convolution of periodic sequences thus corresponds to multiplication of 
the corresponding periodic sequences of Fourier series coefficients. 

Since periodic convolutions are somewhat different from aperiodic convolutions, 
it is worthwhile to consider the mechanics of evaluating Eq. (8.27). First note that 
Eq. (8.27) calls for the product of sequences x\ [m] andx2[n — m] = X2[—(m — n)] viewed 
as functions of m with n fixed. This is the same as for an aperiodic convolution, but with 
the following two major differences: 

1, The sum is over the finite interval < m < N — 1. 

2, The values of X2[n — m] in the interval < m < N — 1 repeat periodically for m 
outside of that interval. 

These details are illustrated by the following example. 
Example 8.4 Periodic Convolution 

An illustration of the procedure for forming the periodic convolution of two periodic 
sequences corresponding to Eq. (8.27) is given in Figure 8.3, where we have illustrated 



o 
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Figure 8.3 Procedure for forming the periodic convolution of two periodic 
sequences. 
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the sequences .^[m], ^i[m], X2[— m], xi[\ — m] = X2[— (m — 1)], and X2[2 — m] = 
X2[—{tn — 2)]. To evaluate Xi[n] in Eq. (8.27) for n = 2, for example, we multiply 
x\ [m] by X2 [2 — m] and then sum the product terms x\ [m] X2 [2 — m] for < m < N — 1 , 
obtaining^ [2]. As n changes, the sequence xi[n—m\ shifts appropriately, and Eq. (8.27) 
is evaluated for each value of < n < N — l.Note that as the sequence xi[n — m] shifts 
to the right or left, values that leave the interval between the dotted lines at one end 
reappear at the other end because of the periodicity. Because of the periodicity of xi[n], 
there is no need to continue to evaluate Eq. (8.27) outside the interval < n < N — 1. 

The duality theorem (Section 8.2.3) suggests that if the roles of time and frequency 
are interchanged, we will obtain a result almost identical to the previous result. That is, 
the periodic sequence 

x 3 [n] = x l [n]x 2 [nl (8.33) 

where x\[n] and X2[n] are periodic sequences, each with period N, has the discrete 
Fourier series coefficients given by 

1 "-' 
*3[*] = ^£*,M* 2 [*-*], (8.34) 



N 



e=o 



corresponding to l/N times the periodic convolution of X\[k] and A^M- This result 
can also be verified by substituting A3 [A:], given by Eq. (8.34), into the Fourier series 
relation of Eq. (8.12) to obtain £3(71]. 

8.2.6 Summary of Properties of the DFS Representation 
of Periodic Sequences 

The properties of the discrete Fourier series representation discussed in this section are 
summarized in Table 8.1. 

TABLE 8.1 SUMMARY OF PROPERTIES OF THE DFS 

Periodic Sequence (Period N) DFS Coefficients (Period N) 

1. x[n] X[k] periodic with period N 

2. i\ [n\, xj[n\ X\[k\ t ^[k] periodic with period N 

3. ax 1 [n] + bx 2 [n] aX^k] + bX 2 [k] 

4. X[n] NJt[-k] 

5. x[n-m] W* m X[k] 

6. W- tn x[n] X[k-£] 

N-1 



7. N ii[w]l2[« — m] (periodic convolution) A^ [/:] AS [/:] 



m=0 



A'-l 



8. .*i[/t]i2[rt] T/ 7 ^i[^]^2[^— ^J (periodic convolution) 



£=0 
9. x*[n] X*[-k] 



(continued ) 
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TABLE 8.1 {Continued) 



Periodic Sequence (Period N) 



DFS Coefficients (Period N) 



10. x*[-n] 

11. Ke{x[n\] 

12. jjm{x[n]\ 

13. x e [n]={{x[n]+x*\-n]) 

14. x t ,[n]={(x[n]-x*[-n]) 
Properties 15-17 apply only when x[n] is real. 

15. Symmetry properties for.v[;i] real. 

16. x e [n]=${x[n] + x[-n]) 

17. x [n]=\(x[n]-x[-n]) 



X*[k] 

X e [k]=\{X[k]+X*[-k]) 

X„[k]={(X[k]-X*[-k]) 

ne{X[k]\ 

jJni{X[k]} 



X[k] = X*[-k] 
Ke{X[k]\ = Ke{X[-k\) 
Jm[X\k]) = -j m [X[-k\\ 
\X[k\\ = \X\-k\\ 
<[X[k] = -<X[-k] 

Ke\X[k\) 
jJm[X[k\) 



8.3 THE FOURIER TRANSFORM OF PERIODIC SIGNALS 

As discussed in Section 2.7, uniform convergence of the Fourier transform of a sequence 
requires that the sequence be absolutely summable, and mean-square convergence 
requires that the sequence be square summable. Periodic sequences satisfy neither 
condition, because they do not approach zero as n approaches ±oo. However, as we 
discussed briefly in Section 2.7, sequences that can be expressed as a sum of complex 
exponentials can be considered to have a Fourier transform representation in the form 
of Eq. (2.152), i.e., as a train of impulses. Similarly, it is often useful to incorporate 
the discrete Fourier series representation of periodic signals within the framework of 
the Fourier transform. This can be done by interpreting the Fourier transform of a 
periodic signal to be an impulse train in the frequency domain with the impulse values 
proportional to the DFS coefficients for the sequence. Specifically, if x[n] is periodic 
with period TV and the corresponding discrete Fourier series coefficients are X[k], then 
the Fourier transform of x[n] is defined to be the impulse train 



k=— oo ^ ^ 



(8.35) 



Note that X(e !0) ) has the necessary periodicity with period 2tt since X[k\ is periodic with 
period N and the impulses are spaced at integer multiples oiln/N, where /Vis an integer. 
To show that X(e^) as defined in Eq. (8.35) is a Fourier transform representation of 
the periodic sequence x[n], we substitute Eq. (8.35) into the inverse Fourier transform 
equation (2.133); i.e., 

i r2n—(: 1 r2n—£ oc y ^. / '?Trk'\ 

~l_ f He*)*'-**--^ £_*[*]*(„-_)</«*, (8.36) 

where € satisfies the inequality < € < (2tt/N). Recall that in evaluating the inverse 
Fourier transform, we can integrate over any interval of length 2tt, since the integrand 
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X(ei a) )e }a,n is periodic with period 2tz. In Eq. (8.36) the integration limits are denoted 
0—6 and 2tz — e, which means that the integration is from just before co = to just before 
co = 2tz\ These limits are convenient because they include the impulse at co = and 
exclude the impulse at co = 2tt. Interchanging the order of integration and summation 
leads to 



1 fin-* 1 °° rln-€ / 27lk\ 

- / X(e ito )e io,n do> =-Y X[k] / 8[ co - — - ) e ia,n dco 

1 N ~ l 



The final form of Eq. (8.37) results because only the impulses corresponding to k = 
0, 1, . . . , (N — 1) are included in the interval between co = — e and co = In — e. 

Comparing Eq. (8.37) and Eq. (8.12), we see that the final right-hand side of 
Eq. (8.37) is exactly equal to the Fourier series representation for x[n], as specified by 
Eq. (8.12). Consequently, the inverse Fourier transform of the impulse train in Eq. (8.35) 
is the periodic signal x[n], as desired. 

Although the Fourier transform of a periodic sequence does not converge in the 
normal sense, the introduction of impulses permits us to include periodic sequences 
formally within the framework of Fourier transform analysis. This approach was also 
used in Chapter 2 to obtain a Fourier transform representation of other nonsummable 
sequences, such as the two-sided constant sequence (Example 2.23) or the complex 
exponential sequence (Example 2.24). Although the discrete Fourier series representa- 
tion is adequate for most purposes, the Fourier transform representation of Eq. (8.35) 
sometimes leads to simpler or more compact expressions and simplified analysis. 

Example 8.5 The Fourier Transform of a Periodic 
Impulse Train 

Consider the periodic impulse train 

p[n]= ^ S[n-rN], (8.38) 

r=— oo 

which is the same as the periodic sequence x[n] considered in Example 8.1. From the 
results of that example, it follows that 

P[k] = l, for all A:. (8.39) 

Therefore, the Fourier transform of p[n] is 

k=-oo ^ / 

The result of Example 8.5 is the basis for a useful interpretation of the relation 
between a periodic signal and a finite-length signal. Consider a finite-length signal x[n] 
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Itt, 



x[n] 



Mr, 



-N 



N 



x[n] 



T T T 



N 



Figure 8.4 Periodic sequence x[n] 
formed by repeating a finite-length 
sequence, x[n], periodically. 
Alternatively, x[n] = x[n] over one 
period and is zero otherwise. 



such that x[n] = except in the interval < n < N — 1, and consider the convolution 
of x[n] with the periodic impulse train p[n] of Example 8.5: 



x[n] — x[n] * p[n] — x[n] * ^ 8[n — r N] 

= V^ x[A7 - fvV]. 



(8.41) 



Equation (8.41) states that x[n] consists of a set of periodically repeated copies of the 
finite-length sequence x[n]. Figure 8.4 illustrates how a periodic sequence x[n] can be 
formed from a finite-length sequence x[n] through Eq. (8.41). The Fourier transform of 
x[n] is X{e^°), and the Fourier transform of x[n] is 



X(e j(0 ) = X(e jlo )P(e ja) ) 



k = — OO 



In k 



(8.42) 



= E^^" 2 ^>'(-^) 



A' = — 30 



Comparing Eq. (8.42) with Eq. (8.35), we conclude that 

X[k] = x(e>V' N ») = X(enl = ^ mk 



(8.43) 



In other words, the periodic sequence X[k] of DFS coefficients in Eq. (8.11) has an 
interpretation as equally spaced samples of the Fourier transform of the finite-length 
sequence obtained by extracting one period of x[n]; i.e., 



x[n] = 



x[n], < n < N — 1. 
0, 



otherwise. 



(8.44) 



This is also consistent with Figure 8.4, where it is clear that x[n] can be obtained from 
x[n] using Eq. (8.44). We can verify Eq. (8.43) in yet another way. Since x[n] — x[n] for 
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< n < N — 1 and x[n] —0 otherwise, 



JV-1 



N-l 



X(e ito ) = ^x[n]e jom = ^x[n]<r^". 



(8.45) 



/I = 



11=0 



Comparing Eq. (8.45) and Eq. (8.11), we see again that 



X[k] = X(e ia> )L=2*k/ N . 



(8.46) 



This corresponds to sampling the Fourier transform at jV equally spaced frequencies 
between co = and co = 2n with a frequency spacing of 2tt/N. 



Example 8.6 Relationship Between the Fourier Series 
Coefficients and the Fourier Transform of One Period 

We again consider the sequence x[n] of Example 8.3, which is shown in Figure 8.1, 
One period of x[n] for the sequence in Figure 8.1 is 



x\n\ — 



1, 0<n<4, 
0, otherwise. 



(8.47) 





(b) 

Figure 8.5 Magnitude and phase of the Fourier transform of one period of the 
sequence in Figure 8.1. 
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The Fourier transform of one period of x[n] is given by 

4 

sin(5oj/2) 



X{e j< ") = ^e jco " = e 



9 -\2a>\ 



«=() 



sin(w/2) 



(8.48) 



Equation (8.46) can be shown to be satisfied for this example by substituting a> — 
2jtk/H) into Eq. (8.48), giving 



X[k] = e-iW 11 " 



s'm(7zk/2) 
sin(7rfc/10) 



which is identical to the result in Eq. (8.18). The magnitude and phase of X(e'"') are 
sketched in Figure 8.5. Note that the phase is discontinuous at the frequencies where 
X(ei ( °) — 0. That the sequences in Figures 8.2(a) and (b) correspond to samples of 
Figures 8.5(a) and (b), respectively, is demonstrated in Figure 8.6, where Figures 8.2 
and 8.5 have been superimposed. 




(a) 



<X{e' b, \-<X[k\ 




(b) 

Figure 8.6 Overlay of Figures 8.2 and 8.5 illustrating the DFS coefficients of a 
periodic sequence as samples of the Fourier transform of one period. 



8.4 SAMPLING THE FOURIER TRANSFORM 



In this section, we discuss with more generality the relationship between an aperiodic 
sequence with Fourier transform X{e }0J ) and the periodic sequence for which the DFS 
coefficients correspond to samples of X{e ja> ) equally spaced in frequency. We will find 
this relationship to be particularly important when we discuss the discrete Fourier trans- 
form and its properties later in the chapter. 
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Unit 
circle 




Figure 8.7 Points on the unit circle at 
which X(z) is sampled to obtain the 

periodic sequence X[k] (N = 8). 



Consider an aperiodic sequence x[n] with Fourier transform X(e* w ), and assume 
that a sequence X[k] is obtained by sampling X(e^ t0 ) at frequencies cok = 2nk/N\ i.e., 



X[k] = X(enL=(2./N)K = X(e 



R2n/N)k 



(8.49) 



Since the Fourier transform is periodic in to with period 2n, the resulting sequence is 
periodic in k with period N. Also, since the Fourier transform is equal to the z-transform 
evaluated on the unit circle, it follows that X[k] can also be obtained by sampling X{z) 
at N equally spaced points on the unit circle. Thus, 



X[k] = X(z)\ z=ei iz*,N>* = X(e J W> k ). 



(8.50) 



These sampling points are depicted in Figure 8.7 for N = 8. The figure makes it clear 
that the sequence of samples is periodic, since the N points are equally spaced starting 
with zero angle. Therefore, the same sequence repeats as k varies outside the range 
0<k< N-l. 

Note that the sequence of samples X[k], being periodic with period N, could be 
the sequence of discrete Fourier series coefficients of a sequence x[ri\. To obtain that 
sequence, we can simply substitute X[k] obtained by sampling into Eq. (8.12): 



t=0 



(8.51) 



Since we have made no assumption about x[n] other than that the Fourier transform 
exists, 



X(e jw )= J2 x [ m V~ h 



(8.52) 



Substituting Eq. (8.52) into Eq. (8.49) and then substituting the resulting expression for 
X[k] into Eq. (8.51) gives 



5Z x[m]t 



■j(27i/N)km 



w, 



A:=0 \_rn=-(x> 

which, after we interchange the order of summation, becomes 



-kn 



N 



(8.53) 



*[n] = J2 X M 



1 /v_1 
k=o 



k(n—m) 



= Y^ jc[m]/?[« — m]. 



(8.54) 



Sec. 8.4 Sampling the Fourier Transform 



557 



x\n] 



(a) 



x \n\ = 2u x\n -r\ 



x[n]= Zj jc[«-H2] 

T — —oo 



12 



t 
N = 12 



(b) 

Figure 8.8 (a) Finite-length sequence x[n]. (b) Periodic sequence x[n] corre- 
sponding to sampling the Fourier transform of x[n] with N = 1 2. 



The term in brackets in Eq. (8.54) can be seen from either Eq. (8.7) or Eq. (8.16) to be 
the Fourier series representation of the periodic impulse train of Examples 8.1 and 8.2. 
Specifically, 



and therefore, 



1 A/-1 oo 

fl* - m J = ji E w ? l "~ m) = E s t" - m - rN ^ 

k=0 r =—oo 



x[n] = x[n] * Y^ 8 [ n ~rN]= ^ x[n - rN], 



(8.55) 



(8.56) 



where * denotes aperiodic convolution. That is, x[n] is the periodic sequence that results 
from the aperiodic convolution of x[n] with a periodic unit-impulse train. Thus, the 
periodic sequence x[n], corresponding to X[k] obtained by sampling X(e^), is formed 
from x[n] by adding together an infinite number of shifted replicas of x[n\. The shifts 
are all the positive and negative integer multiples of N, the period of the sequence 
X[k). This is illustrated in Figure 8.8, where the sequence x[n) is of length 9 and the 
value of N in Eq. (8.56) is N — 12. Consequently, the delayed replications of x[n] do 
not overlap, and one period of the periodic sequence x[n] is recognizable as x[n]. This 
is consistent with the discussion in Section 8.3 and Example 8.6 wherein we showed 
that the Fourier series coefficients for a periodic sequence are samples of the Fourier 
transform of one period. In Figure 8.9 the same sequence x[n] is used, but the value 
of N is now jV = 7. In this case the replicas of x[n] overlap and one period of x[n] is 
no longer identical to x[n]. In both cases, however, Eq. (8.49) still holds; i.e., in both 
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Figure 8.9 Periodic sequence x[n] corresponding to sampling the Fourier trans- 
form of x[n] in Figure 8.8(a) with N = 7. 



cases the DFS coefficients of x[n] are samples of the Fourier transform of x[n] spaced 
in frequency at integer multiples of 2tt/ N. This discussion should be reminiscent of our 
discussion of sampling in Chapter 4. The difference is that here we are sampling in the 
frequency domain rather than in the time domain. However, the general outlines of the 
mathematical representations are very similar. 

For the example in Figure 8.8, the original sequence x[n] can be recovered from 
x[n] by extracting one period. Equivalently, the Fourier transform X(c^'") can be re- 
covered from the samples spaced in frequency by 2n/\2. In contrast, in Figure 8.9, 
x[n] cannot be recovered by extracting one period of x[n]. and, equivalently, X(e' a> ) 
cannot be recovered from its samples if the sample spacing is only 2tt/1. In effect, for 
the case illustrated in Figure 8.8, the Fourier transform of x[n] has been sampled at a 
sufficiently small spacing (in frequency) to be able to recover it from these samples, 
whereas Figure 8.9 represents a case for which the Fourier transform has been under- 
sampled. The relationship between x[n] and one period of x[n] in the undersampled 
case can be thought of as a form of aliasing in the time domain, essentially identical 
to the frequency-domain aliasing (discussed in Chapter 4) that results from undersam- 
pling in the time domain. Obviously, time-domain aliasing can be avoided only if x[n] 
has finite length, just as frequency-domain aliasing can be avoided only for signals that 
have bandlimited Fourier transforms. 

This discussion highlights several important concepts that will play a central role 
in the remainder of the chapter. We have seen that samples of the Fourier transform of 
an aperiodic sequence x[n] can be thought of as DFS coefficients of a periodic sequence 
x[n] obtained through summing periodic replicas of x[n\. If x[n] has finite length and we 
take a sufficient number of equally spaced samples of its Fourier transform (specifically, 
a number greater than or equal to the length of x[/?]), then the Fourier transform is 
recoverable from these samples, and, equivalently, x[n] is recoverable from the corre- 
sponding periodic sequence x[n] through the relation 



x[n] = 



x[n], < n < N — 1, 
0, otherwise. 



(8.57) 



A direct relationship between X(e J0J ) and its samples X[k], i.e., an interpolation 
formula for X(e ja> ) 7 can be derived (see Problem 8.54). However, the essence of our 
previous discussion is that to represent or to recover x[n] it is not necessary to know 
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X{e }0J ) at all frequencies if x[n] has finite length. Given a finite-length sequence x[n], 
we can form a periodic sequence using Eq. (8.56), which in turn can be represented by 
a discrete Fourier series. Alternatively, given the sequence of Fourier coefficients X[k], 
we can find x[n] and then use Eq. (8.57) to obtain x[n]. When the Fourier series is used in 
this way to represent finite-length sequences, it is called the discrete Fourier transform 
(DFT). In developing, discussing, and applying the DFT, it is always important to 
remember that the representation through samples of the Fourier transform is in effect 
a representation of the finite-duration sequence by a periodic sequence, one period of 
which is the finite-duration sequence that we wish to represent. 



8.5 FOURIER REPRESENTATION OF FINITE-DURATION 
SEQUENCES: THE DISCRETE FOURIER TRANSFORM 

In this section, we formalize the point of view suggested at the end of the previous 
section. We begin by considering a finite-length sequence x[n] of length N samples such 
that x[n] = outside the range < n < N — 1. In many instances, we will want to 
assume that a sequence has length N even if its length is M < N. In such cases, we 
simply recognize that the last (N — M) samples are zero. To each finite-length sequence 
of length N, we can always associate a periodic sequence 

oo 

x[n] = Y^ x[n-rN]. (8.58a) 

r——oo 

The finite-length sequence x[n] can be recovered from x[n] through Eq. (8.57), i.e., 

*M = fn H ' °^ "-"-'• (8.58b) 

L J ^ 0, otherwise. 

Recall from Section 8.4 that the DFS coefficients of x[n] are samples (spaced in 
frequency by 2n/N) of the Fourier transform of x[n\. Since x[n] is assumed to have 
finite length N, there is no overlap between the terms x[n — r N] for different values of 
r. Thus, Eq. (8.58a) can alternatively be written as 

x[n] = x[(n modulo N)]. (8.59) 

For convenience, we will use the notation ((n))^ to denote (n modulo N); with this 
notation, Eq. (8.59) is expressed as 

x[n] = x[((n)) N ]. (8.60) 

Note that Eq. (8.60) is equivalent to Eq. (8.58a) only when x[n] has length less than or 
equal to N. The finite-duration sequence x [n] is obtained from x[n] by extracting one 
period, as in Eq. (8.58b). 

One informal and useful way of visualizing Eq. (8.59) is to think of wrapping a plot 
of the finite-duration sequence x[n] around a cylinder with a circumference equal to the 
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length of the sequence. As we repeatedly traverse the circumference of the cylinder, we 
see the finite-length sequence periodically repeated. With this interpretation, represen- 
tation of the finite-length sequence by a periodic sequence corresponds to wrapping the 
sequence around the cylinder; recovering the finite-length sequence from the periodic 
sequence using Eq. (8.58b) can be visualized as unwrapping the cylinder and laying it flat 
so that the sequence is displayed on a linear time axis rather than a circular (modulo N) 
time axis. 

As defined in Section 8.1, the sequence of discrete Fourier series coefficients X[k] 
of the periodic sequence x[n] is itself a periodic sequence with period N. To maintain a 
duality between the time and frequency domains, we will choose the Fourier coefficients 
that we associate with a finite-duration sequence to be a finite-duration sequence cor- 
responding to one period of X[k]. This finite-duration sequence, X[k], will be referred 
to as the discrete Fourier transform (DFT). Thus, the DFT, X[k], is related to the DFS 
coefficients, X[k], by 

( X[k], 0<k<N-\, 
X[k] = { ~ " (8.61) 

[ 0, otherwise, 

and 

X[k] = X[(k modulo N)] = X[((k)) N ]. (8.62) 

From Section 8.1, X[k] and x[n] are related by 

N-\ 

*[*] = 5>MW]&". (8.63) 



n=0 

N 



1 N-\ 

*M = w E ^M^/". (8-64) 



Jt=0 



Since the summations in Eqs. (8.63) and (8.64) involve only the interval between zero 
and (N - 1), it follows from Eqs. (8.58b)-(8.64) that 



N-l 



VxM< n , 0<k<N-l, 
X[k\ ={f, (8-65) 



0, otherwise. 



N-\ 



. ^J2X[k]WN kn , 0<n<N-\, 
x[n] = {N to (8-66) 



0, otherwise. 
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Generally, the DFT analysis and synthesis equations are written as follows: 

N-\ 

Analysis equation: X[k] = ^ x[n]W$\ (8.67) 



n=0 

N- 1 



Synthesis equation: x[n] = — ^ X[k]W^ k ". (8.68) 

That is, the fact that X[k] = for k outside the interval < k < N - 1 and that x[n] = 
for n outside the interval < n < N — 1 is implied, but not always stated explicitly. The 
relationship between x[n] and X[k] implied by Eqs. (8.67) and (8.68) will sometimes be 
denoted as 

x[n] S^ X[k}. (8.69) 

In recasting Eqs. (8.1 1) and (8.12) in the form of Eqs. (8.67) and (8.68) for finite- 
duration sequences, we have not eliminated the inherent periodicity. As with the DFS, 
the DFT X[k] is equal to samples of the periodic Fourier transform X(e }a> ), and if 
Eq. (8.68) is evaluated for values of n outside the interval < n < N — 1 , the result 
will not be zero, but rather a periodic extension of x[n\. The inherent periodicity is 
always present. Sometimes it causes us difficulty and sometimes we can exploit it, but to 
totally ignore it is to invite trouble. In defining the DFT representation, we are simply 
recognizing that we are interested in values of x[n] only in the interval < n < N — 1 
because x[n] is really zero outside that interval, and we are interested in values of X[k] 
only in the interval < k < N—\ because these are the only values needed in Eq. (8.68). 

Example 8.7 The DFT of a Rectangular Pulse 

To illustrate the DFT of a finite-duration sequence, consider x[n] shown in Fig- 
ure 8.10(a). In determining the DFT, we can consider x[n] as a finite-duration se- 
quence with any length greater than or equal to TV = 5. Considered as a sequence of 
length N = 5, the periodic sequence x[n] whose DFS corresponds to the DFT of x[n] 
is shown in Figure 8.10(b). Since the sequence in Figure 8.10(b) is constant over the 
interval < n < 4, it follows that 

x[k] = y e -« 2 'W" = ' ' . m 

L J /-^ 1 _ e -j(2jzk/5) 

n=0 

(8.70) 

[5, * = 0,±5,±10,..., 
1 0, otherwise; 

i.e., the only nonzero DFS coefficients X[k] are at k = and integer multiples of 
k = 5 (all of which represent the same complex exponential frequency). The DFS 
coefficients are shown in Figure 8.10(c). Also shown is the magnitude of the Fourier 
transform, \X(e^)\. Clearly, X[k] is a sequence of samples of X(e^ M ) at frequencies 
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Figure 8.10 Illustration of the DFT. (a) Finite-length sequence x[n]. (b) Periodic 
sequence x[n] formed from x[n] with period /V = 5. (c) Fourier series coefficients 
X [k] for x[n]. To emphasize that the Fourier series coefficients are samples of the 
Fourier transform, \X{e jco )\ is also shown, (d) DFof x[n]. 



cx) k — 27ik/5. According to Eq. (8.61), the five-point DFT of x[n] corresponds to the 
finite-length sequence obtained by extracting one period of X[k]. Consequently, the 
five-point DFT of x[n] is shown in Figure 8.10(d). 

If, instead, we consider x[n] to be of length N = 10, then the underlying periodic 
sequence is that shown in Figure 8.11(b), which is the periodic sequence considered 
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(d) 

Figure 8.11 Illustration of the DFT. (a) Finite-length sequence x[n\. (b) Periodic 
sequence x[n] formed from x[n] with period N = 10. (c) DFT magnitude, (d) DFT 
phase, (x's indicate indeterminate values.) 

in Example 8.3. Therefore, X[k] is as shown in Figures 8.2 and 8.6, and the 10-point 
DFT X[k] shown in Figures 8.11(c) and 8.11(d) is one period of X[k]. 



The distinction between the finite-duration sequence x[n] and the periodic se- 
quence x[n] related through Eqs. (8.57) and (8.60) may seem minor, since, by using 
these equations, it is straightforward to construct one from the other. However, the 
distinction becomes important in considering properties of the DFT and in considering 
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the effect on x[n] of modifications to X[k]. This will become evident in the next section, 
where we discuss the properties of the DFT representation. 

8.6 PROPERTIES OF THE DISCRETE FOURIER TRANSFORM 

In this section, we consider a number of properties of the DFT for finite-duration 
sequences. Our discussion parallels the discussion of Section 8.2 for periodic sequences. 
However, particular attention is paid to the interaction of the finite-length assumption 
and the implicit periodicity of the DFT representation of finite-length sequences. 

8.6.1 Linearity 

If two finite-duration sequences jci [n] and x 2 [n] are linearly combined, i.e., if 

xi[n] = axi[n] + iu^M, (8.71) 

then the DFT of x$[n] is 

X 3 [k] = aXi[k] + bX 2 [k]. (8.72) 

Clearly, if x\[n] has length N\ andx 2 [n] has length N 2 , then the maximum length of x^ln] 
will be N3 = max[/Vi , N 2 ]. Thus, in order for Eq. (8.72) to be meaningful, both DFTs 
must be computed with the same length N > jV 3 . If, for example, N\ < N 2 , then X\ [k] 
is the DFT of the sequence x\[n] augmented by (N 2 — N\) zeros. That is, the Appoint 
DFT of x\[n] is 

iVi-J 

X l [k]=J2x l [n]W^_, 0<fc<N 2 -l, (8.73) 

and the Appoint DFT of x 2 [n] is 

Xi[k] = J2 ^H^I', 0<k<N 2 -l. (8.74) 

In summary, if 



and 
then 



X][n] 2S Xi[k] (8.75a) 



x 2 [n] 2S X 2 [k], (8.75b) 



axi[n] + bx 2 [n] +^> aX } [k] + bX 2 [k], (8.76) 



where the lengths of the sequences and their discrete Fourier transforms are all equal 
to the maximum of the lengths of x\[n] and x 2 [n]. Of course, DFTs of greater length 
can be computed by augmenting both sequences with zero-valued samples. 

8.6.2 Circular Shift of a Sequence 

According to Section 2.9.2 and property 2 in Table 2.2, if X(e^ to ) is the Fourier transform 
of jc[/i], then e~^ m X(e^) is the Fourier transform of the time-shifted sequence x[n — m]. 
In other words, a shift in the time domain by m points (with positive m corresponding 
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to a time delay and negative m to a time advance) corresponds in the frequency do- 
main to multiplication of the Fourier transform by the linear phase factor e~J ww . In Sec- 
tion 8.2.2, we discussed the corresponding property for the DFS coefficients of a pe- 
riodic sequence; specifically, if a periodic sequence x[n] has Fourier series coefficients 
X[k], then the shifted sequence x [n — m] has Fourier series coefficients e~^ 2nk,N ^ m X[k]. 
Now we will consider the operation in the time domain that corresponds to multiply- 
ing the DFT coefficients of a finite-length sequence x[n] by the linear phase factor 
e -j(2nk/N)m t specifically, let x\[n] denote the finite-length sequence for which the DFT 
ise-* 2nk/N)m X[k];U.,if 

x[n] <^i X[k] y (8.77) 

then we are interested in x\ [n] such that 

xi [n] <^i X x [k] = e- }{2jTk/N)m X[kl (8.78) 

Since the jV-point DFT represents a finite-duration sequence of length N, both x[n] and 
xi[n] must be zero outside the interval < n < N — 1, and consequently, x\[n] cannot 
result from a simple time shift of x[n]. The correct result follows directly from the result 
of Section 8.2.2 and the interpretation of the DFT as the Fourier series coefficients of 
the periodic sequence x\ [((«))#]. In particular, from Eqs. (8.59) and (8.62) it follows that 

x[n] = x[((n)) N ] £S X[k] = X[((k)) N l (8.79) 

and similarly, we can define a periodic sequence jci [n] such that 

xi[n] = jci [((/i))w] ™ X,[k] = X![((k)) N l (8.80) 

where, by assumption, 

Xi[k\ = e-K 2nk/N)m X[k]. (8.81) 

Therefore, the discrete Fourier series coefficients of x\ [n] are 

X x [k] = e-> [2 * m) " /N]m X[((k)) N ]. (8.82) 

Note that 

e -j[2n((k)) N /N} m _ e -j{2nk/N)m^ (8.83) 

That is, since e -iK 2jik l N ) m is periodic with period N in both k and m, we can drop the 
notation ((k)) N . Hence, Eq. (8.82) becomes 

X x [k] = e-H 2 * k/N)m X[k], (8.84) 

so that it follows from Section 8.2.2 that 

Jci [n] = x[n - m] = x[((n - m)) N ]. (8.85) 

Thus, the finite-length sequence x\[n] whose DFT is given by Eq. (8.81) is 

r r„l - / ^ W = *K(« -m))n]* 0<n< 
11 J ~ \0, otherwis 

Equation (8.86) tells us how to construct x\ [n]. 



otherwise. 



(8.86) 
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Example 8.8 Circular Shift of a Sequence 

The circular shift procedure is illustrated in Figure 8.12 for m = —2; i.e., we want to 
determine x\[n\ = x[((n + 2)),\] for N = 6, which we have shown will have DFT 
X] [k] — W~ 2k X[k]. Specifically, from x[n], we construct the periodic sequence x[n] = 
.v[((«)) 6 ], as indicated in Figure 8.12(b). According to Eq. (8.85), we then shift x[n] by 
2 to the left, obtaining x\[n] = x[n + 2] as in Figure 8.12(c). Finally, using Eq. (8.86), 
we extract one period of aj [n] to obtain .V| [/?], as indicated in Figure 8. 1 2(d). 




.v, [«],()< n < N- 1 
0. otherwise 



Figure 8.12 Circular shift of a finite-length sequence; i.e., the effect in the time 
domain of multiplying the DFT of the sequence by a linear phase factor. 

A comparison of Figures 8.12(a) and (d) indicates clearly that x\[n] does not 
correspond to a linear shift of x[n], and in fact, both sequences are confined to the 
interval between and (N — 1). By reference to Figure 8.12, we see that x\ [n] can be 
formed by shifting x[n] so that as a sequence value leaves the interval to (N — 1 ) at 
one end, it enters at the other end. Another interesting point is that, for the example 
shown in Figure 8.12(a), if we form X2[n] = x[((n — 4))6] by shifting the sequence by 
4 to the right modulo 6, we obtain the same sequence as x\ [«]. In terms of the DFT, 
this results because W^ k — VV 6 " 2/: or, more generally, W^ k = W^ , which implies 

that an /V-point circular shift in one direction by m is the same as a circular shift in the 
opposite direction by yV — m. 
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In Section 8.4, we suggested the interpretation of forming the periodic sequence 
x[n] from the finite-length sequence x[n] by displaying x[n] around the circumference 
of a cylinder with a circumference of exactly jY points. As we repeatedly traverse the 
circumference of the cylinder, the sequence that we see is the periodic sequence x[n]. 
A linear shift of this sequence corresponds, then, to a rotation of the cylinder. In the 
context of finite-length sequences and the DFT, such a shift is called a circular shift or 
a rotation of the sequence in the interval < n < N — 1. 

In summary, the circular shift property of the DFT is 

x[((n - m)) N ], 0<n<N~\'S^i e- ji2jTk/N)m X[k]. (8.87) 



8.6.3 Duality 

Since the DFT is so closely associated with the DFS, we would expect the DFT to exhibit 
a duality property similar to that of the DFS discussed in Section 8.2.3. In fact, from an 
examination of Eqs. (8.67) and (8.68), we see that the analysis and synthesis equations 
differ only in the factor \/N and the sign of the exponent of the powers of W^. 

The DFT duality property can be derived by exploiting the relationship between 
the DFT and the DFS as in our derivation of the circular shift property. Toward this 
end, consider x[n] and its DFT X[k], and construct the periodic sequences 

x[n] = *[((/!))„], (8.88a) 

X[k] = X[((k)) N l (8.88b) 

so that 

x[n] £S X[k]. (8.89) 

From the duality property given in Eqs. (8.25), 

X[n] £S Nx[-k\. (8.90) 

If we define the periodic sequence x\[n] = X[n], one period of which is the finite- 
length sequence X[[n] = X[n], then the DFS coefficients of xi[n] are Xy[k] = Nx[— k]. 
Therefore, the DFT of x\ [n] is 

Xl[ki -\0, otherwise, (8 ' 91) 



or, equivalently, 



*W -{^-"M. o^-l (8 , 2) 



Consequently, the duality property for the DFT can be expressed as follows: If 



then 



x[n] +?% X[k], (8.93a) 



X[n] '^i Nx[((-k)) N ], < k < N - 1. (8.93b) 
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The sequence Nx[((-k)) N ] is Nx[k] index reversed, modulo N. As in the case of 
shifting modulo N, the process of index reversing modulo N is usually best visualized 
in terms of the underlying periodic sequences. 

Example 8.9 The Duality Relationship for the DFT 

To illustrate the duality relationship in Eqs. (8.93), let us consider the sequence x[n] of 
Example 8.7. Figure 8.13(a) shows the finite-length sequence x[n], and Figures 8.13(b) 
and 8.13(c) are the real and imaginary parts, respectively, of the corresponding 
10-point DFT X[k]. By simply relabeling the horizontal axis, we obtain the com- 
plex sequence x\ [n] = X[n], as shown in Figures 8.13(d) and 8.13(e). According to the 
duality relation in Eqs. (8.93), the 10-point DFT of the (complex-valued) sequence 
X[n] is the sequence shown in Figure 8.13(f). 



8.6.4 Symmetry Properties 

Since the DFT of x[n] is identical to the DFS coefficients of the periodic sequence 
x[n] = x[((n)) N ], symmetry properties associated with the DFT can be inferred from the 
symmetry properties of the DFS summarized in Table 8.1 in Section 8.2.6. Specifically, 
using Eqs. (8.88) together with properties 9 and 10 in Table 8.1, we have 



and 



x*[n] 2^i X*[((-k)) N ], 0<n<N-\, (8.94) 



x*[((-n)) N ]*^ X*[k], 0<n<N-l. (8.95) 



Properties 11-14 in Table 8.1 refer to the decomposition of a periodic sequence into the 
sum of a conjugate-symmetric and a conjugate-antisymmetric sequence. This suggests 
the decomposition of the finite-duration sequence x[n] into the two finite-duration 
sequences of duration N corresponding to one period of the conjugate-symmetric and 
one period of the conjugate-antisymmetric components of x[n]. We will denote these 
components of x[n] as x ep [n] and x op [«]. Thus, with 

x[n] = x[((n)) N ] (8.96) 

and the conjugate-symmetric part being 

x e [n] = \{x[n] + x*[-n]l (8.97) 

and the conjugate-antisymmetric part being 

x [n] = \[x[n]-x*[-n]}, (8.98) 

we define x ep [n] and x op [n] as 

x ep [n] = x e [n], < n < N - 1, (8.99) 

Xo P [n] = x [n], < n < N - 1, (8.100) 

or, equivalently, 

*e P M = \{x[((n)) N ] + **[((-«))*]}, < n < N- 1, (8.101a) 

x op [n] = \{x[((n)) N ] - **[((-«))*]}, < n < N - 1, (8.101b) 
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Figure 8.13 Illustration of duality. 

(a) Real finite-length sequence x[n]. 

(b) and (c) Real and imaginary 
parts of corresponding DFT X[k]. 

(d) and (e) The real and imaginary parts 
of the dual sequence *i [n] = X [n], 
(f) The DFT of *,[/?]. 
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with both x Qp [n] and Jc op [n] being finite-length sequences, i.e., both zero outside the 
interval < n < N — 1. Since ((— n)) N = (N - n) and ((n))/v = n for < n < N - 1, we 
can also express Eqs. (8.101) as 



x ep [n]= \{x[n\ + x*[N-n]}, 


1 <*< W-l, 


(8.102a) 


x ep [0] = Ke{x[0]}, 




(8.102b) 


x op [n] = \{x[n] -x*[N-n]}, 


1 <n< N-l, 


(8.102c) 


^o P [0] = jjm{x[0]). 




(8.102d) 



This form of the equations is convenient, since it avoids the modulo N computation of 
indices. 

Clearly, x ep [n] and x op [n] are not equivalent to x e [n] and x () [n] as defined by 
Eq. (2.154). However, it can be shown (see Problem 8.56) that 

x ep [n] = {x e [n] + x e [n- N]}, < n < N - 1, (8.103) 

and 

x op [n] = [x [n] + x a [n - N]), 0<n<N-l. (8.104) 

In other words, x ep [n] and x op [n\ can be generated by aliasing x e [n] and x a [n] into the 
interval < n < N— 1. The sequences x ep [n] and x op [n] will be referred to as the periodic 
conjugate-symmetric and periodic conjugate-antisymmetric components, respectively, of 
x[n]. When x ep [n] and x op [n] are real, they will be referred to as the periodic even and 
periodic odd components, respectively. Note that the sequences x e pM and Jt pM are 
not periodic sequences; they are, however, finite-length sequences that are equal to one 
period of the periodic sequences x e [n] and x [n], respectively. 

Equations (8.101) and (8.102) define x ep [n] and x op [n] in terms of x[n]. The in- 
verse relation, expressing x[n] in terms of jc ep [n] and x op [n], can be obtained by using 
Eqs. (8.97) and (8.98) to express x[n] as 

x[n] = x e [n] +x [n]. (8.105) 

Thus, 

x[n] = x[n] = x e [n] + x [n], < n < N - 1. (8.106) 

Combining Eqs. (8.106) with Eqs. (8.99) and (8.100), we obtain 

x[n] = Xe P [n] + Xop[n]. (8.107) 

Alternatively, Eqs. (8.102), when added, also lead to Eq. (8.107). The symmetry prop- 
erties of the DFT associated with properties 11-14 in Table 8.1 now follow in a straight- 
forward way: 

He[x[n]} <^ AT ep [Jk], (8.108) 

jjm{x[n]} ^i X op [k], (8.109) 

x Qp [n] 2^ 7Le{X[k\), (8.110) 

*o P M ^5 jJm{X[k\). (8.111) 
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8.6.5 Circular Convolution 

In Section 8.2.5, we showed that multiplication of the DFS coefficients of two periodic 
sequences corresponds to a periodic convolution of the sequences. Here we consider 
two finite-duration sequences x\[n] and x 2 [n], both of length N> with DFTs X\[k] and 
X 2 [k], respectively, and we wish to determine the sequence x 3 [n] for which the DFT 
is X 3 [k] = X\[k]X 2 [k]. To determine x 3 [n], we can apply the results of Section 8.2.5. 
Specifically, x 3 [n] corresponds to one period of x 3 [n], which is given by Eq. (8.27). Thus, 

x 3 [n] = ^2xi[m]x 2 [n-m] t 0<n< N-\, (8.112) 

m=Q 

or, equivalently, 

A/-1 

x 3 [n] = J>i [(( m ))N]x2[((n - m)) N ], < n < N - 1. (8.113) 

m=l) 

Since ((m))^ = m for < m < N — 1 , Eq. (8.113) can be written 

N-\ 

x A n ] = ^2 x \[ m ]x2[((n ~ m)) N ], 0<n < N - 1. (8.114) 

Equations (8.112) and (8.114) differ from a linear convolution of x\[n] and x 2 [n] 
as defined by Eq. (2.52) in some important respects. In linear convolution, the computa- 
tion of the sequence value x 3 [n\ involves multiplying one sequence by a time-reversed 
and linearly shifted version of the other and then summing the values of the product 
ii[m]i2[« — m\ over all m. To obtain successive values of the sequence formed by the 
convolution operation, the two sequences are successively shifted relative to each other. 
In contrast, for the convolution defined by Eq. (8.114), the second sequence is circu- 
larly time reversed and circularly shifted with respect to the first. For this reason, the 
operation of combining two finite -length sequences according to Eq. (8.114) is called 
circular convolution. More specifically, we refer to Eq. (8.114) as an N-point circular 
convolution, explicity identifying the fact that both sequences have length N (or less) 
and that the sequences are shifted modulo N. Sometimes the operation of forming a 
sequence x 3 [n] for < n < N - 1 using Eq. (8.114) will be denoted 

x 3 [n]= Xl [n]®x 2 [n]. (8.115) 

Since the DFT of x 3 [n] is X 3 [k] = Xi[k]X 2 [k\ and since X^X^k] = X 2 [k]Xi[k\ it 
follows with no further analysis that 

x 3 [n] =x 2 [n] ®xi[n], (8.116) 

or, more specifically, 

N-l 

x 3 [n] = Y,X2[m]xi[((n-m)) N ]. (8.117) 

m=0 

That is, circular convolution, like linear convolution, is a commutative operation. 

Since circular convolution is really just periodic convolution, Example 8.4 and 
Figure 8.3 are also illustrative of circular convolution. However, if we utilize the notion 
of circular shifting, it is not necessary to construct the underlying periodic sequences as 
in Figure 8.3. This is illustrated in the following examples. 
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Example 8.10 Circular Convolution with a Delayed Impulse 
Sequence 

An example of circular convolution is provided by the result of Section 8.6.2. Let x-i [n] 
be a finite-duration sequence of length N and 

xi[n] = &[n-n ], (8.118) 

where < no < N. Clearly, x\ [n] can be considered as the finite-duration sequence 



0, < n < no, 
x\[n] = ^ 1, n = «o, 

0, no < n < N - 1. 



(8.119) 



as depicted in Figure 8.14 for no — 1. 



x 2 [m] 



It.... 



N 



m 



x } [m] 



N 



m 



-• — • — •- 



jf 2 [((0-wi))jv],0</n<N-l 



-• — • — • — •- 



N 



jc 2 [((1 -m)) N ],0<m <N-1 



-• — • — •- 



1 



-• — • — • — •- 



N 



m 



. . . T 



Xi[n]=x 1 [n]@x 2 [n] 
-J — • — • — • — • 



N 



Figure 8.14 Circular convolution of a finite-length sequence x 2 [n] with a single 
delayed impulse, x^n] = 8[n - 1]. 
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The DFT of x x [n] is 



X l [k] = W^"°. (8.120) 



If we form the product 



rkn 



X 3 [k] = W* n °X 2 [kl (8.121) 



we see from Section 8.6.2 that the finite-duration sequence corresponding to X?\k\ is 
the sequence X2[n] rotated to the right by no samples in the interval < n < N — 1. 
That is, the circular convolution of a sequence X2[n] with a single delayed unit impulse 
results in a rotation of X2[n] in the interval < n < N — 1. This example is illustrated 
in Figure 8.14 for N = 5 and no — 1. Here we show the sequences x 2 [m] and x\ [m] and 
then *2l((0 — m))/v] and jc 2 [((1 - m))^]. It is clear from these two cases that the result 
of circular convolution of X2[n] with a single shifted unit impulse will be to circularly 
shift x 2 [n]. The last sequence shown is ^[/i], the result of the circular convolution of 
Jt][n] and X2[n]. j '•''■'. ' ' - 



Example 8.11 Circular Convolution of Two 
Rectangular Pulses 

As another example of circular convolution, let 

xi[n] = x 2 [n] = I I' 0^n<L-h 

11 L J |0, otherwise, v 

where, in Figure 8.15, L = 6. If we let jV denote the DFT length, then, for N = L, the 
jV-point DFTs are 

*[*] = *[*] = IX" = {o"' ^else. < 8 ' 123) 



If we explicitly multiply X\[k\ and ^[/c], we obtain 

*,[*] = *[*]*[*] = {£ 2 ' ^.^ (8.124) 

from which it follows that 

x 3 [n] = N, 0<n<N-l. (8.125) 

This result is depicted in Figure 8.15. Clearly, as the sequence x 2 [((n — m))/v] is rotated 
with respect to *i[m], the sum of products xi[m]jC2[((« — m)) N ] will always be equal 
toN. 

It is, of course, possible to consider xi[n] and X2[n] as 2L-point sequences 
by augmenting them with L zeros. If we then perform a 2L-point circular convo- 
lution of the augmented sequences, we obtain the sequence in Figure 8.16, which 
can be seen to be identical to the linear convolution of the finite-duration sequences 
x\[n\ and x 2 [n]. This important observation will be discussed in much more detail in 
Section 8.7. 
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Note that for N = 2L, as in Figure 8.16, 



X ] [k] = X 2 [k] = 



1- W#* 



so the DFT of the triangular-shaped sequence xj,[n] in Figure 8.16(e) is 



X,[k] = 






with/V=2L. 



1 1 t t t t 



x { [n] 



N 

(a) 
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(c) 



Figure 8.15 /V-point circular convolution of two constant sequences of length N. 
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Figure 8.16 2 /.-point circular convolution of two constant sequences of 
length L. 
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Figure 8.16 (Continued) 

The circular convolution property is represented as 

xi[n] ®x 2 [n] 2^i X'i[k]X 2 [k]. (8.126) 

In view of the duality of the DFT relations, it is not surprising that the DFT of a product 
of two vV-point sequences is the circular convolution of their respective discrete Fourier 
transforms. Specifically, if x^[n] = xi[n]x2[n], then 

1 N-l 

X *W = w £ X ^ X Mk - t)) N ] (8.127) 



t=o 



or 



xi[n]x 2 [n]^ ^X l [k]®X 2 [k]. 



(8.128) 



8.6.6 Summary of Properties of the Discrete 
Fourier Transform 

The properties of the discrete Fourier transform that we discussed in Section 8.6 are 
summarized in Table 8.2. Note that for all of the properties, the expressions given specify 
x[n] for < n < N - 1 and X[k] for < k < N - 1. Both x[n] and X[k] are equal to 
zero outside those ranges. 
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TABLE 8.2 



Finite-Length Sequence (Length N) 



JV-point DFT (Length N) 



1. x[n] 

2. xi[n],X2[n] 

3. flJtj [/i] + fo^M 

4. X[n] 

5. x[((n-m)) N ] 

6. W„ e "x[n] 

N-] 

8. Jfi[«]jf2[n] 

9. x*[n] 

10. x*[((-n)) N ] 

11. 7le{x[n]\ 

12. jjm{x[n]) 

13. Jfep[/i]=^Wn] + Jf*[((-n))w]} 

14. *o P ["] = i {*["]-**[((-«))*]} 
Properties 15-17 apply only when x[n] is real. 



15. Symmetry properties 



16. x ep [n]= l -[x[n] + x[((-n)) N ]} 

17. xop[n]=\{x[n]-x[((-n)) N ]} 



X[k] 

X l [klX 2 [k] 
aXi[k] + bX 2 [k] 
Nx[U-k)) N ) 

wi m x[k\ 



' N 

X[((k 



*))n] 



Xi[k]X 2 [k] 



N-l 

l -J2x l (ox 2 [((k-t)) N ] 



N 

X*[((-k)) N ] 

X*[k] 

X ep [k] = ] -[X[((k)) N ] + X*[((-k)) N ]) 

Xo P [k]=±{X[((k)) N ]-X*[((-k)) N ]} 

Ke[X[k]} 

jJm{X[k]} 

X[k] = X*[((-k)) N ] 
ne(X[k]} = 7U[X[((-k)) N ]) 
Jm(X[k]} = -Jm{X[((-k)) N ]) 
\X[k]\ = \X[((-k)) N ]\ 
<[X[k]} = -«[X[((-k)) N ]) 

1leiX[k]} 
jJm(X[k]} 



8.7 LINEAR CONVOLUTION USING THE DISCRETE 
FOURIER TRANSFORM 

We will show in Chapter 9 that efficient algorithms are available for computing the 
discrete Fourier transform of a finite-duration sequence. These are known collectively 
as fast Fourier transform (FFT) algorithms. Because these algorithms are available, it is 
computationally efficient to implement a convolution of two sequences by the following 
procedure: 

(a) Compute the Appoint discrete Fourier transforms X\[k] and Xi [k] of the two 
sequences x\[n] and X2[n], respectively. 

(b) Compute the product X 3 [k] = Xi[k]X 2 [k] for < k < N - 1. 

(c) Compute the sequence x^ln] = x\[n] (n) x 2 [n] as the inverse DFT of -Y 3 [/c]. 
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In most applications, we are interested in implementing a linear convolution of two 
sequences; i.e., we wish to implement a linear time-invariant system. This is certainly 
true, for example, in filtering a sequence such as a speech waveform or a radar signal or 
in computing the autocorrelation function of such signals. As we saw in Section 8.6.5, the 
multiplication of discrete Fourier transforms corresponds to a circular convolution of 
the sequences. To obtain a linear convolution, we must ensure that circular convolution 
has the effect of linear convolution. The discussion at the end of Example 8.1 1 hints at 
how this might be done. We now present a more detailed analysis. 

8.7.1 Linear Convolution 

of TWo Finite-Length Sequences 

Consider a sequence x\ [n] whose length is L points and a sequence xi[n] whose length 
is P points, and suppose that we wish to combine these two sequences by linear convo- 
lution to obtain a third sequence 

DO 

xj\n]= Yl xi[m]x 2 [n - m]. (8.129) 

in — -oc 

Figure 8.17(a) shows a typical sequence x\[m] and Figure 8.17(b) shows a typical se- 
quence x 2 [n — m] for several values of n. Clearly, the product Jti[/w]jt2[w — m] is zero 
for all m whenever n < and n > L + P — 2; i.e., x^[n] ^ for < n < L+ P — 2. 
Therefore, (L+ P — 1) is the maximum length of the sequence x$[n] resulting from the 
linear convolution of a sequence of length L with a sequence of length P. 

8.7.2 Circular Convolution as Linear Convolution 
with Aliasing 

As Examples 8.10 and 8.11 show, whether a circular convolution corresponding to the 
product of two Appoint DFTs is the same as the linear convolution of the corresponding 
finite-length sequences depends on the length of the DFT in relation to the length 
of the finite-length sequences. An extremely useful interpretation of the relationship 
between circular convolution and linear convolution is in terms of time aliasing. Since 
this interpretation is so important and useful in understanding circular convolution, we 
will develop it in several ways. 

In Section 8.4 we observed that if the Fourier transform X(e^ y ) of a sequence x[n] 
is sampled at frequencies cok = 27ik/N, then the resulting sequence corresponds to the 
DFS coefficients of the periodic sequence 

DO 

x[n] = J2 x[n-rN]. (8.130) 

r— — oo 

From our discussion of the DFT, it follows that the finite-length sequence 

XM = I W*""")- 0<k<N-\, 
1 ' I 0, otherwise, \ ■ - > 
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Figure 8.17 Example of linear convolution of two finite-length sequences 
showing that the result is such that x$[n] = for n < -1 and for n > L + P - 1 . 
(a) Finite-length sequence x^ [n]. (b) x 2 [n - m] for several values of n. 



is the DFT of one period of x[n], as given by Eq. (8.130); i.e., 

' x[n], 0<«<N-1, 



x p [n] = 



0, 



otherwise. 



(8.132) 



Obviously, if x[n] has length less than or equal to N, no time aliasing occurs and x p [n] = 
x[n]. However, if the length of x[n] is greater than N, x p [n] may not be equal to x[n] for 
some or all values of n. We will henceforth use the subscript p to denote that a sequence 
is one period of a periodic sequence resulting from an inverse DFT of a sampled Fourier 
transform. The subscript can be dropped if it is clear that time aliasing is avoided. 
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The sequence x 3 [n] in Eq. (8.129) has Fourier transform 

X 3 (e ito ) = X x (e jw )X 2 (e j(l> ). (8.133) 

If we define a DFT 

X 2 [k] = X 3 (e j{2nk/N) ), 0<k<N-l, (8.134) 

then it is clear from Eqs. (8.133) and (8.134) that, also 

X 3 [k] = Xi(e J{2irk/N) )X 2 (e ii23tk/N) ) t < k < N - 1, (8.135) 

and therefore, 

X 3 [k] = X l [k\X 2 [k]. (8.136) 

That is, the sequence resulting as the inverse DFT of X 3 [k] is 



I JTjc 3 [rt-rN], 0<«<N-1, 



0, otherwise, 

and from Eq. (8.136), it follows that 

x 3p [n] = x l [n}®x 2 [n}. (8.138) 

Thus, the circular convolution of two finite-length sequences is equivalent to linear 
convolution of the two sequences, followed by time aliasing according to Eq. (8.137). 

Note that if N is greater than or equal to either L or P, X\[k] and X 2 [k] rep- 
resent x\[n] and x 2 [n] exactly, but x 3p [n] = xi[n] for all n only if N is greater than or 
equal to the length of the sequence x?,[n]. As we showed in Section 8.7.1, if x\[n] has 
length Landj^M has length F, then X3[n] has maximum length (L+ P—l). Therefore, 
the circular convolution corresponding to Ai[A:]AT2[fc] is identical to the linear con- 
volution corresponding to Xi(e ja) )X2(e J ' a> ) if N, the length of the DFTs, satisfies 
N> L+P-l. 



Example 8.12 Circular Convolution as Linear Convolution 
with Aliasing 

The results of Example 8.15 are easily understood in light of the interpretation just 
discussed. Note that x\[n] and x 2 [n] are identical constant sequences of length L — 
P = 6, as shown in Figure 8.18(a). The linear convolution of x\[n] and x 2 [n\ is 
of length L-\- P — 1 = 11 and has the triangular shape shown in Figure 8.18(b). 
In Figures 8.18(c) and (d) are shown two of the shifted versions x?\n - rN] in 
Eq. (8.137), X3[n — N] and xj\n -\- N] for N — 6. The Appoint circular convolution 
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(f) 

Figure 8.18 Illustration that circular convolution is equivalent to linear 
convolution followed by aliasing, (a) The sequences x<\[n] and X2[n] to be 
convolved, (b) The linear convolution of *i [n] and Xz[ri\. (c) x$[n — N]\wN = 6. 
(d) xz[n + A/ ] for N = 6. (e) x^ [n] © x 2 [n], which is equal to the sum of (b), (c), 
and (d) in the interval < n < 5. (f) xi[n] ® x 2 [n]. 



Sec. 8.7 Linear Convolution Using the Discrete Fourier Transform 



581 



of xi[n] and xj[n] can be formed by using Eq. (8.137). This is shown in Figure 8.18(e) 
for N = L = 6 and in Figure 8.18(f) for N = 2L = 12. Note that for N = L = 6, only 
X2,[n] and X3[« + N] contribute to the result. For N = 2L= 12, only x^[n] contributes 
to the result. Since the length of the linear convolution is {2L — 1), the result of the 
circular convolution for N = 2L is identical to the result of linear convolution for all 
Q < n < N — 1. In fact, this would be true for N = 2L — 1 = 11 as well. 

As Example 8.12 points out, time aliasing in the circular convolution of two finite- 
length sequences can be avoided if ;V > L + P — 1. Also, it is clear that if N = L — F, 
all of the sequence values of the circular convolution may be different from those 
of the linear convolution. However, if P < L, some of the sequence values in an 
L-point circular convolution will be equal to the corresponding sequence values of the 
linear convolution. The time-aliasing interpretation is useful for showing this. 

Consider two finite-duration sequences x\[n] and X2[n], with x\[n] of length Land 
x 2 [n] of length P, where P < L, as indicated in Figures 8.19(a) and 8.19(b), respectively. 
Let us first consider the L-point circular convolution of x\[n] and xi[n] and inquire as 
to which sequence values in the circular convolution are identical to values that would 
be obtained from a linear convolution and which are not. The linear convolution of 
xi[n] with x 2 [n] will be a finite-length sequence of length (L+ P — 1), as indicated in 
Figure 8.19(c). To determine the L-point circular convolution, we use Eqs. (8.137) and 
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Figure 8.19 An example of linear 
convolution of two finite-length 
sequences. 
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(8.138) so that 

* 3 ,[„] = J *' W ® X2[n] = ^ [n ~ rL] ' ° ^ n ^ L ~ h (8.139) 

0, otherwise. 

Figure 8.20(a) shows the term in Eq. (8.139) for r = 0, and Figures 8.20(b) and 8.20(c) 
show the terms for r — —\ and r = +1, respectively. From Figure 8.20, it should be 
clear that in the interval < n < L— 1, Jt3 P |/?] is influenced only by xi[n] and x^[n + L]. 

In general, whenever P < L, only the term x$[n + L] will alias into the in- 
terval < n < L — 1. More specifically, when these terms are summed, the last 
(P — 1) points of x$[n + L], which extend from n = Q \o n — P — 2, will be added 
to the first (P — 1) points of Xi,[n], and the last (P — 1) points of Jt3[rt], extending 
from /?= Lton= L+ P — 2, will be discarded. Then jc 3/ , [«] is formed by extract- 
ing the portion for < n < L — 1. Since the last (P — 1) points of x$[n + L] and 
the last (P — 1) points of ^[w] are identical, we can alternatively view the process 
of forming the circular convolution ^3 /; [«] through linear convolution plus aliasing as 
taking the (P — 1) values of x^[n] from n — L to n = L+ P — 2 and adding them 
to the first (P — 1) values of x^[n]. This process is illustrated in Figure 8.21 for the 
case P = 4 and L = 8. Figure 8.21(a) shows the linear convolution x^[n], with the 
points for n > L denoted by open symbols. Note that only (P — 1) points for « > L 
are nonzero. Figure 8.21(b) shows the formation of ^[tf] by "wrapping xi[n] around 
on itself." The first (P — 1) points are corrupted by the time aliasing, and the remain- 
ing points from n — P — 1 to n = L — 1 (i.e., the last L — P + 1 points) are not 
corrupted; that is, they are identical to what would be obtained with a linear convolu- 
tion. 

From this discussion, it should be clear that if the circular convolution is of suffi- 
cient length relative to the lengths of the sequences x\[n] and *2M, then aliasing with 
nonzero values can be avoided, in which case the circular convolution and linear con- 
volution will be identical. Specifically, if, for the case just considered, x^[n] is replicated 
with period N > L + P — 1, then no nonzero overlap will occur. Figures 8.21(c) and 
8.21(d) illustrate this case, again for P = 4 and L = 8, with iV = 11. 



8.7.3 Implementing Linear Time-Invariant Systems 
Using the DFT 

The previous discussion focused on ways of obtaining a linear convolution from a circu- 
lar convolution. Since linear time-invariant systems can be implemented by convolution, 
this implies that circular convolution (implemented by the procedure suggested at the 
beginning of Section 8.7) can be used to implement these systems. To see how this can be 
done, let us first consider an L-point input sequence x[n] and a P-point impulse response 
h[n\. The linear convolution of these two sequences, which will be denoted by y[n], has 
finite duration with length ( L+ P—l). Consequently, as discussed in Section 8.7.2, for the 
circular convolution and linear convolution to be identical, the circular convolution must 
have a length of at least (L-h P — l) points. The circular convolution can be achieved by 
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Figure 8.20 Interpretation of circular convolution as linear convolution followed 
by aliasing for the circular convolution of the two sequences x-\[n) and x 2 [n] in 
Figure 8.19. 



multiplying the DFTs of x[n] and h[n\. Since we want the product to represent the DFT 
of the linear convolution of x[n] and h[n], which has length (L+ P — 1), the DFTs that we 
compute must also be of at least that length, i.e., both x[n] and h[n] must be augmented 
with sequence values of zero amplitude. This process is often referred to as zero-padding. 
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Xi P [n] = x 1 [n]®x 2 [n], 
N=L +P-1 



N 
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Figure 8.21 Illustration of how the 
result of a circular convolution "wraps 
around." (a) and (b) N = L, so the 
aliased "tail" overlaps the first (P - 1) 
points, (c) and (d) N = {L + P - 1), so 
no overlap occurs. 



This procedure permits the computation of the linear convolution of two finite- 
length sequences using the discrete Fourier transform; i.e., the output of an FIR system 
whose input also has finite length can be computed with the DFT. In many applications, 
such as filtering a speech waveform, the input signal is of indefinite duration. While, 
theoretically, we might be able to store the entire waveform and then implement the 
procedure just discussed using a DFT for a large number of points, such a DFT is 
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Figure 8.22 Finite-length impulse response h[n] and indefinite-length signal x[n] 
to be filtered. 



generally impractical to compute. Another consideration is that for this method of 
filtering, no filtered samples can be computed until all the input samples have been 
collected. Generally, we would like to avoid such a large delay in processing. The solution 
to both of these problems is to use block convolution, in which the signal to be filtered 
is segmented into sections of length L. Each section can then be convolved with the 
finite-length impulse response and the filtered sections fitted together in an appropriate 
way. The linear filtering of each block can then be implemented using the DFT. 

To illustrate the procedure and to develop the procedure for fitting the filtered 
sections together, consider the impulse response h[n] of length P and the signal x[n] 
depicted in Figure 8.22. Henceforth, we will assume that x[n] = for n < and that 
the length of x[n\ is much greater than P. The sequence x[n] can be represented as a 
sum of shifted finite-length segments of length L; i.e., 



*m = Y2 Xr ^ n _r ^]' 



r=0 



where 



x r [n] = 



x[n + rL], < n < L- 1, 
0, otherwise. 



(8.140) 



(8.141) 



Figure 8.23(a) illustrates this segmentation for x[n] in Figure 8.22. Note that within each 
segment, the first sample is at n = 0; however, the zeroth sample of x r [n] is the rLth 
sample of the sequence x[ri\. This is shown in Figure 8.23(a) by plotting the segments 
in their shifted positions. 

Because convolution is a linear time-invariant operation, it follows from Eq. (8.140) 
that 



where 



y[n] = x[n] * h[n] = ^2y r [n- rL], 
y r [n] = x r [n]*h[n]. 



(8.142) 
(8.143) 
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- Figure 8.23 (a) Decomposition 
of x[n] in Figure 8.22 into 
nonoverlapping sections of length L. 
(b) Result of convolving each section 
with h[n]. 



Since the sequences x r [n] have only L nonzero points and h[n] is of length P, each 
of the terms y r [n] = x r [n] * h[n] has length (L+ P — 1). Thus, the linear convolution 
x r [n] * h[n] can be obtained by the procedure described earlier using vV-point DFTs, 
where N > L + P — 1. Since the beginning of each input section is separated from its 
neighbors by L points and each filtered section has length (L + P — 1), the nonzero 
points in the filtered sections will overlap by (P — 1) points, and these overlap samples 
must be added in carrying out the sum required by Eq. (8.142). This is illustrated in 
Figure 8.23(b), which shows the filtered sections, y r [n] = x r [n] * h[n\. Just as the input 
waveform is reconstructed by adding the delayed waveforms in Figure 8.23(a), the fil- 
tered result x[n] * h[n] is constructed by adding the delayed filtered sections depicted 
in Figure 8.23(b). This procedure for constructing the filtered output from filtered sec- 
tions is often referred to as the overlap-add method, because the filtered sections are 
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overlapped and added to construct the output. The overlapping occurs because the 
linear convolution of each section with the impulse response is, in general, longer than 
the length of the section. The overlap-add method of block convolution is not tied 
to the DFT and circular convolution. Clearly, all that is required is that the smaller 
convolutions be computed and the results combined appropriately. 

An alternative block convolution procedure, commonly called the overlap-save 
method, corresponds to implementing an L-point circular convolution of a P-point 
impulse response h[n\ with an L-point segment x r [n\ and identifying the part of the 
circular convolution that corresponds to a linear convolution. The resulting output 
segments are then "patched together" to form the output. Specifically, we showed that 
if an L-point sequence is circularly convolved with a P-point sequence (P < L), then 
the first ( P — 1 ) points of the result are incorrect, while the remaining points are identical 
to those that would be obtained had we implemented a linear convolution. Therefore, 
we can divide x[n] into sections of length L so that each input section overlaps the 
preceding section by (P — 1) points. That is, we define the sections as 

x r [n] = x[n + r{L- P + \) - P+l], 0<« < L-l, (8.144) 

where, as before, we have defined the time origin for each section to be at the beginning 
of that section rather than at the origin of x[n]. This method of sectioning is depicted in 
Figure 8.24(a). The circular convolution of each section with h[n] is denoted y rp |/?], the 
extra subscript p indicating that y Tp [n] is the result of a circular convolution in which 
time aliasing has occurred. These sequences are depicted in Figure 8.24(b). The portion 
of each output section in the region < n < P — 2 is the part that must be discarded. 
The remaining samples from successive sections are then abutted to construct the final 
filtered output. That is, 

oc 

y[n] = ^ yr [ n -r(L-P+l) + P-\], (8.145) 

where 

J L [0, otherwise. v f 

This procedure is called the overlap-save method because the input segments overlap, 
so that each succeeding input section consists of (L — P + 1) new points and (P — 1) 
points saved from the previous section. 

The utility of the overlap-add and the overlap-save methods of block convolution 
may not be immediately apparent. In Chapter 9, we consider highly efficient algorithms 
for computing the DFT. These algorithms, collectively called the fast Fourier transform 
(FFT), are so efficient that, for FIR impulse responses of even modest length (on the 
order of 25 or 30), it may be more efficient to carry out block convolution using the 
DFT than to implement the linear convolution directly. The length P at which the DFT 
method becomes more efficient is, of course, dependent on the hardware and software 
available to implement the computations. (See Stockham, 1966, and Helms, 1967.) 
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Figure 8.24 (a) Decomposition of x[n] in Figure 8.22 into overlapping sections 
of length L. (b) Result of convolving each section with h[n). The portions of each 
filtered section to be discarded in forming the linear convolution are indicated. 
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8.8 THE DISCRETE COSINE TRANSFORM (DCT) 

The DFT is perhaps the most common example of a general class of finite-length trans- 
form representations of the form 

A[k] = Y,xW4>l[nl ( 8 - 147 ) 

, N-] 

x[n] = -Y, A WMn], (8.148) 

k=0 

where the sequences 4>k[n], referred to as the basis sequences, are orthogonal to one 
another; i.e., 

^i>«,M = U; Z = / L (8.149) 

11=0 K 

In the case of the DFT, the basis sequences are the complex periodic sequences e ^ 27rkn/N y 
and the sequence A[k] is, in general, complex even if the sequence x[n] is real. It is natural 
to inquire as to whether there exist sets of real-valued basis sequences that would yield 
a real-valued transform sequence A[k] when x[ri] is real. This has led to the definition 
of a number of other orthogonal transform representations, such as Haar transforms, 
Hadamard transforms (Elliott and Rao, 1982), and Hartley transforms (Bracewell, 1983, 
1984, 1986) (The definition and properties of the Hartley transform are explored in 
Problem 8.65.) Another orthogonal transform for real sequences is the DCT, or dis- 
crete cosine transform. (See Ahmed et al., 1974 and Rao and Yip, 1990.) The DCT is 
closely related to the DFT and has become especially useful and important in a number 
of signal-processing applications, particularly speech and image compression. In this 
section, we conclude our discussion of the DFT by introducing the DCT and showing 
its relationship to the DFT. 

8.8.1 Definitions of the DCT 

The DCT is a transform in the form of Eqs. (8.147) and (8.148) with basis sequences 
<i>k[n\ that are cosines. Since cosines are both periodic and have even symmetry, the 
extension of x[n] outside the range < n < (TV - 1) in the synthesis equation (8.148) 
will be both periodic and symmetric. In other words, just as the DFT involves an implicit 
assumption of periodicity, the DCT involves implicit assumptions of both periodicity 
and even symmetry. 

In the development of the DFT, we represented finite-length sequences by first 
forming periodic sequences from which the finite-length sequence can be uniquely re- 
covered and then utilizing an expansion in terms of periodic complex exponentials. In 
a similar style, the DCT corresponds to forming a periodic, symmetric sequence from 
a finite-length sequence in such a way that the original finite-length sequence can be 
uniquely recovered. Because there are many ways to do this, there are many definitions 
of the DCT In Figure 8.25, we show 17 samples for each of four examples of symmet- 
ric periodic extensions of a four-point sequence. The original finite-length sequence is 
shown in each subfigure as the samples with solid dots. These sequences are all periodic 
(with period 16 or less) and also have even symmetry. In each case, the finite length 
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Figure 8.25 Four ways to extend a four-point sequence x[n] both periodically 
and symmetrically. The finite-length sequence x[n] is plotted with solid dots, 
(a) Type-1 periodic extension for DCT-1. (b) Type-2 periodic extension for DCT-2. 
(c) Type-3 periodic extension for DCT-3. (d) Type-4 periodic extension for DCT-4. 

sequence is easily extracted as the first four points of one period. For convenience, we de- 
note the periodic sequences obtained by replicating with period 16 each of the four sub- 
sequences in Figure 8.25(a), (b), (c) and (d) as x\ [«], ^[/i], x$[n], and x^n], respectively. 
We note that x\ [n] has period (IN— 2) = 6 and has even symmetry about both n = and 
n = (N — 1) = 3. The sequence x 2 [n] has period 2N = 8 and has even symmetry about 
the "half sample" points n = — | and |. The sequence x^[n] has period AN = 16 and 
has even symmetry about n = and n = 8. The sequence X4[n] also has period 4iV = 16 
and even symmetry about the "half sample" points n = — ^ and n = (2N — |) = y . 

The four different cases shown in Figure 8.25 illustrate the periodicity that is im- 
plicit in the four common forms of the DCT, which are referred to as DCT-1, DCT-2, 
DCT-3, and DCT-4 respectively. It can be shown (see Martucci, 1994) that there are four 
more ways to create an even periodic sequence from x[n]. This implies four other possi- 
ble DCT representations. Furthermore, it is also possible to create eight odd-symmetric 
periodic real sequences from x[n], leading to eight different versions of the discrete sine 
transform (or DST), where the basis sequences in the orthonormal representation are 
sine functions. These transforms make up a family of 16 orthonormal transforms for 
real sequences. Of these, the DCT-1 and DCT-2 representations are the most used, and 
we shall therefore focus on them in the remainder of our discussion. 

8.8.2 Definition of the DCT-1 and DCT-2 

All of the periodic extensions leading to different forms of the DCT can be thought of 
as a sum of shifted copies of the N-point sequences ±x[n] and ±x[— «]. Hie differences 
between the extensions for the DCT-1 and DCT-2 depend on whether the endpoints 
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overlap with shifted versions of themselves and, if so, which of the endpoints overlap. 
For the DCT-1, x[n] is first modified at the endpoints and then extended to have period 
2N — 2. The resulting periodic sequence is 

xi[n] = x a [((n)) 2N -2] + x a [((-n)hN-il (8.150) 

where x a [n] is the modified sequence x a [n] = a[n]x[n], with 

r 1 f j, n = 0andN-l, 
ce[n] = { 2 (8.151) 

\l, 1 <n< N-2. V 

The weighting of the endpoints compensates for the doubling that occurs when the 
two terms in Equation (8.150) overlap at n = 0, n = (N - 1), and at the corresponding 
points spaced from these by integer multiples of (27V— 2). With this weighting, it is easily 
verified that x[n] = x\[n] for n = 0,1, . . . , N —1. The resulting periodic sequence x\[n] 
has even periodic symmetry about the points n = and n = N — 1,2/V — 2, etc., which 
we refer to as Type-1 periodic symmetry. The DCT-1 is defined by the transform pair 



X cl [k]= 2 J2a[n]x[n] cos (^^-\ < k < N - 1, (8.152) 

x[n] = ^T T E a M A ' Cl M cos (j£^y 0<n<N-l, (8.153) 

where a[n] is defined in Eq. (8.151). 

For the DCT-2, x[n] is extended to have period 2N, and the periodic sequence is 
given by 

x 2 [n] = x[((n)) 2N ] + x[((-n - 1)) 2N ], (8.154) 

Because the endpoints do not overlap, no modification of them is required to ensure that 
x[n] — X2[ri\ lorn = 0, 1, . . . , N—l. In this case, which we call Type-2 periodic symmetry, 
the periodic sequence X2[ri\ has even periodic symmetry about the "half sample" points 
— 1/2, Af — 1/2, 2N — 1/2, etc. The DCT-2 is defined by the transform pair 



X c2 [k] = 2 5>Mcos ( ^ (2/Z + 1) ) , 0<k<N-l, (8.155) 

*M = ^ E PW^W cos ( ^m^ ) ' 0<n<N-h (8.156) 



k=0 

where the inverse DCT-2 involves the weighting function 



«*]=!: ii°k< N -i. (8i57) 
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Figure 8.26 DCT-1 and DCT-2 for the four-point sequence used in Figure 8.25. 
(a)DCT-1.(b)DCT-2. 

In many treatments, the DCT definitions include normalization factors that make the 
transforms unitary? For example, the DCT-2 form is often defined as 



n={) 



k=0 



nk(2n + \) 

2/V 

nk(2n + \) 

2N 



where 



0[k]=l & *~°' 

PL J M, k= 1,2,..., N-l 



0<k<N-\, (8.158) 
0<n < N-\, (8.159) 

(8.160) 



Comparing these equations with Equations (8.155) and (8.156), we see that the multi- 
plicative factors 2, 1/jY, and fi[k] have been redistributed between the direct and inverse 
transforms. (A similar normalization can be applied to define a normalized version of 
the DCT-1.) While this normalization creates a unitary transform representation, the 
definitions in Eqs. (8.152) and (8.153) and Eqs. (8.155) and (8.156) are simpler to relate 
to the DFT as we have defined it in this chapter. Therefore, in the following discus- 
sions, we use our definitions rather than the normalized definitions that are found, for 
example, in Rao and Yip (1990) and many other texts. 

Although we normally evaluate the DCT only for < k < N— 1, nothing prevents 
our evaluating the DCT equations outside that interval, as illustrated in Figure 8.26, 
where the DCT values for < k < N — 1 are shown as solid dots. These figures 
illustrate that the DCTs also are even periodic sequences. However, the symmetry of 
the transform sequence is not always the same as the symmetry of the implicit periodic 
input sequence: While xi [n] and the extension of X cl [k] both have Type-1 symmetry, we 

3 The DCT would be a unitary transform if it is orthonormal and also has the property that 

JV-l JV-l 

.2 



^(x[n]) 2 = ^(X*[k]f 



«=o 



k=0 
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see from a comparison of Figures 8.25(c) and 8.26(b) that ^ c2 [A:] has the same symmetry 
as X3[n] rather than X2[n], 

Since the DCTs are orthogonal transform representations, they have properties 
similar in form to those of the DFT. These properties are elaborated on in some detail 
in Ahmed et al (1974) and Rao and Yip (1990). 

8.8.3 Relationship between the DFT and the DCT-1 

As we would expect, there is a close relationship between the DFT and the various 
classes of the DCT of a finite-length sequence. To develop this relationship, we note 
that, since, for the DCT-1, x\[n] is constructed from X[[n] through Eqs. (8.150) and 
(8.151), one period of the periodic sequence x\[n] defines the finite-length sequence 

*i M = x a [((n)) 2N - 2 ] + x a [((-n)) 2N -2] = xi[n], n = 0, 1, . . . , IN - 3, (8.161) 

where x a [n] = a[n]x[n] is the N-point real sequence with endpoints divided by 2. From 
Equation (8.161 ), it follows that the (2N- 2)-point DFT of the (2N — 2)-point sequence 
x\[n] is 

Xi[k] = X a [k] + X* a [k] = ZRe{X a [k]l k = 0, 1, . . . , 2N - 3, (8.162) 

where X a [k] is the (IN — 2)-point DFT of the TV-point sequence or [«]*[«]; i.e., a[«]x[«] 
is padded with (N - 2) zero samples. Using the definition of the (IN — 2)-point DFT 
of the padded sequence, we obtain 

N-l , -, \ 

X { [k] = 2Ke[X a [k]} = 2 £<*[*]*[/!] cos I ^^) = X cl [k\ (8.163) 

Therefore, the DCT-1 of an N-point sequence is identical to the (27V - 2)-point DFT 
of the symmetrically extended sequence x\[n\, and it is also identical to twice the real 
part of the first N points of the (2N — 2)-point DFT of the weighted sequence x a [ri\. 

Since, as discussed in Chapter 9, fast computational algorithms exist for the DFT, 
they can be used to compute the DFTs X a [k] or X\[k\ in Equation (8.163), thus pro- 
viding a convenient and readily available fast computation of the DCT-1. Since the 
definition of the DCT-1 involves only real-valued coefficients, there are also efficient 
algorithms for computing the DCT-1 of real sequences more directly, without requiring 
the use of complex multiplications and additions. (See Ahmed et al., 1974 and Chen 
et al., 1977.) 

The inverse DCT-1 can also be computed using the inverse DFT. It is only nec- 
essary to use Equation (8.163) to construct X x [k] from ^ cl [/c] and then compute the 
inverse (2N — 2)-point DFT. Specifically, 

*ra={£!|&_2-*]. J=S;:.':.2N-3. (8 - 164) 

and, using the definition of the (2N — 2)-point inverse DFT, we can compute the sym- 
metrically extended sequence 

. 2/V-3 

* lW = 27V^2 ^ XiWe j7jTkn/i2N - 2 \ n = 0, 1, . . . , 2N - 3, (8.165) 
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from which we can obtain x[n] by extracting the first TV points, i.e., x[n] = x\[n] for 
n = 0, 1, . . . , TV - 1. By substitution of Eq. (8.164) into Eq. (8.165), it also follows that 
the inverse DCT-1 relation can be expressed in terms of X cl [k] and cosine functions, as 
in Equation (8.153). (See Problem 8.68.) 



8.8.4 Relationship between the DFT and the DCT-2 

It is also possible to express the DCT-2 of a finite-length sequence x[n] in terms of the 
DFT. To develop this relationship, observe that one period of the periodic sequence 
x 2 [n] defines the 2TV-point sequence 

x 2 [n] = x[((n)) 2N ] + x[((-n - 1)) 2 „] = jc 2 [n], n = 0, 1 2N-1, (8.166) 

where x[n] is the original N-point real sequence. From Equation (8.166), it follows that 
the 2TV-point DFT of the 2N-point sequence x 2 [n] is 

X 2 [k] = X[k] + X*[k]e i2 * k/{2N K * = 0. 1 2TV - 1, (8.167) 

where X[k] is the 2/V-point DFT of the TV-point sequence x[n]\ i.e., in this case, x[n] is 
padded with TV zero samples. From Equation (8.167), we obtain 

X 2 [k] = X[k] + X*[k]e l2TTkl(2N) 

= e J7Tkl{2N) (x[k]e- jnk/(2N) + X*[k]e j7rk/(2N) ) (8.168) 

= e i" k/ l 2N hTle{x[k]e->' Tk/{2N) }. 
From the definition of the 2 TV-point DFT of the padded sequence, it follows that 

Ke{x[k\e-^ 1N )) = X>[«]cos ( "^^ %) ) ■ (S- 1 ^) 

Therefore, using Equations (8.155), (8.167), and (8.169), we can express A^/:] in terms 
of X[k], the 2A r -point DFT of the TV-point sequence x[n], as 

X c2 [k] = ZRei X[k]e- jnk/{2N) \, k = 0, 1, . . . , N - 1, (8.170) 

or in terms of the 2TV-point DFT of the 2TV-point symmetrically extended sequence 
x 2 [n] defined by Equation (8.166) as 

X c2 [k] = e- j7Tk/(2N) X 2 [kl k = 0, 1 , . . . , TV - 1, (8.171) 

and equivalently, 

X 2 [k] = e jlTk/i2N) X c2 [kl k = 0, 1, . . . , TV - 1. (8.172) 

As in the case of the DCT-1, fast algorithms can be used to compute the DFTs 
in Equations (8.170) and (8.171). Makhoul (1980) discusses other ways that the DFT 
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can be used to compute the DCT-2. (See also Problem 8.69.) In addition, special fast 
algorithms for the computation of the DCT-2 have been developed (Rao and Yip, 1990). 
The inverse DCT-2 can also be computed using the inverse DFT. The procedure 
utilizes Eq. (8.172) together with a symmetry property of the DCT-2. Specifically, it is 
easily verified by direct substitution into Eq. (8.155) that 

X c2 [2N -k] = -X c2 [k], k = 0, 1, . . . , IN - 1, (8.173) 

from which it follows that 



X 2 [k] = I 



( X c2 [0], k = 0, 

e J*VVN)X c2 [k], k=h...,N-h 

0, k = N. 

_ e Jnk!{2N) x c2y 2N _q k=N+\,N+2 2N-\ 



(8.174) 



Using the definition of the inverse DFT, we can compute the symmetrically extended 
sequence 

« 2/V-l 

x 2 [n] = — J2 X 2 [k}e l7jTknl{2N \ n = 0, 1 2N-1. (8.175) 



*=o 



from which we can obtain x [n] = x 2 [n] for n = 0, 1 , . . . , N— 1 . By substituting Eq. (8. 1 74) 
into Eq. (8.175), we can easily show that the inverse DCT-2 relation is that given by 
Eq. (8.156). (See Problem 8.70.) 



8.8.5 Energy Compaction Property of the DCT-2 

The DCT-2 is used in many data compression applications in preference to the DFT 
because of a property that is frequently referred to as "energy compaction. " Specifically, 
the DCT-2 of a finite-length sequence often has its coefficients more highly concentrated 
at low indices than the DFT does. The importance of this flows from Parseval's theorem, 
which, for the DCT-1, is 

N-\ ^ N-\ 

$>[«M«]I 2 = yjv^E^Ml^'Ml 2 . (8-176) 

and, for the DCT-2, is 

N-l 1 A/-1 

E I*MI 2 = t^ E £Ml* c2 Ml 2 , (8.177) 

«=0 Jt=0 

where ft[k] is defined in Eq. (8.157). The DCT can be said to be concentrated in the 
low indices of the DCT if the remaining DCT coefficients can be set to zero without 
a significant impact on the energy of the signal. We illustrate the energy compaction 
property in the following example. 
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Example 8.13 Energy Compaction in the DCT-2 

Consider a test input of the form 

x[n] = a n co$(co n + <f>), n = 0, 1 , . . . , N - 1 . (8.178) 

Such a signal is illustrated in Figure 8.27 for a = .9, coq = O.Itt, <p = 0, and N — 32. 
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Figure 8.27 Test signal for comparing DFT and DCT 

The real and imaginary parts of the 32-point DFT of the 32-point sequence in 
Figure 8.27 are shown in Figures 8.28(a) and (b), respectively, and the DCT-2 of the 
sequence is shown in Figure 8.28(c). In the case of the DFT, the real and imaginary 
parts are shown for k = 0, 1, . . . , 16. Since the signal is real, X[0] and ^[16] are real. 
The remaining values are complex and conjugate symmetric. Thus, the 32 real num- 
bers shown in Figures 8.28(a) and (b) completely specify the 32-point DFT. In the 
case of the DCT-2, we show all 32 of the real DCT-2 values. Clearly, the DCT-2 values 
are highly concentrated at low indices, so Parseval's theorem suggests that the energy 
of the sequence is more concentrated in the DCT-2 representation than in the DFT 
representation. 

This energy concentration property can be quantified by truncating the two 
representations and comparing the mean-squared approximation error for the two 
representations when both use the same number of real coefficient values. To do this, 
we define 



1 " -1 
4 f >] = — ^ T m [k]X[k]e j7jrkn/N , h = 0, 1, . . . , W - 1, 



(8.179) 



where, in this case, X[k] is the JV-point DFT of x[n] and 

{1, 0<k<(N-l-m)/2, 
0, (N + 1 - m)/2 <k<(N-l+ m)/2, 
1, (N+l+m)/2<k< N-l. 

If m = 1, the term X[N/2] is removed. If m = 3, then the terms X[N/2] and X[N/2-l] 
and its corresponding complex conjugate X[N/2 + 1] are removed, and so forth; i.e., 

j*^, ft [rt] for m = 1, 3, 5 N — 1 is the sequence that is synthesized by symmetrically 

omitting m DFT coefficients. 4 With the exception of the DFT value, X[N/2], which 



*For simplicity, we assume that N is an even integer. 
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Figure 8.28 (a) Real part of /V-point DFT; (b) Imaginary part of /V-point DFT; (c) 
/V-point DCT-2 of the test signal plotted in Figure 8.27. 



is real, each omitted complex DFT value and its corresponding complex conjugate 
actually corresponds to omitting two real numbers. For example, m = 5 would cor- 
respond to setting the coefficients X[\A\ ^[15], ^[16], X[\l], and ^[18] to zero in 
synthesizing jc| ft [/i] from the 32-point DFT shown in Figures 8.28(a) and (b). 
Likewise, we can truncate the DCT-2 representation, obtaining 



N-\-m 



,dct 



k=0 ^ / 



0<n<N-l. (8.180) 



In this case, if m = 5, we omit the DCT-2 coefficients ^ c2 [27], . . . , Jf c2 [31] in the 
synthesis of x^ ct [/i] from the DCT-2 shown in Figure 8.28(c). Since these coefficients 
are very small, jc| ct [n] should differ only slightly from x[n]. 

To show how the approximation errors depend on m for the DFT and the DCT-2, 
we define 



n=0 
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Figure 8.29 Comparison of truncation errors for DFT and DCT-2. 



and 



E da lni] = ljY t \x[n]-xi a [n]\ : 



to be the mean-squared approximation errors for the truncated DFT and DCT, re- 
spectively. These errors are plotted in Figure 8.29, with £" dft [w] indicated with o and 
£ dct [/w] shown with •. For the special cases m = (no truncation) and m = N-\ (only 
the DC value is retained), the DFT truncation function is To[k] = 1 for < k < N — 1 
and T^-\[k] = for 1 < k < N — 1 and r/v-][0] = 1. In these cases, both represen- 
tations give the same error. For values 1 < m < 30, the DFT error grows steadily as 
m increases, while the DCT error remains very small up to about m = 25, implying 
that the 32 numbers of the sequence x[n] can be represented with slight error by only 
seven DCT-2 coefficients. 

The signal in Example 8.13 is a low frequency exponentially decaying signal with 
zero phase. We have chosen this example very carefully to emphasize the energy com- 
paction property. Not every choice of x[n] will give such dramatic results. Highpass 
signals and even some signals of the form of Equation (8.178) with different param- 
eters do not show this dramatic difference. Nevertheless, in many cases of interest in 
data compression, the DCT-2 provides a distinct advantage over the DFT. It can be 
shown (Rao and Yip, 1990) that the DCT-2 is nearly optimum in the sense of minimum 
mean-squared truncation error for sequences with exponential correlation functions. 



8.8.6 Applications of the DCT 

The major application of the DCT-2 is in signal compression, where it is a key part 
of many standardized algorithms. (See Jayant and Noll, 1984 and Rao and Hwang, 
1996.) In this application, the blocks of the signal are represented by their cosine trans- 
forms. The popularity of the DCT in signal compression is mainly due to its energy 
concentration property, which we demonstrated by a simple example in the previous 
section. 

The DCT representations, being orthogonal transforms like the DFT, have many 
properties similar to those of the DFT that make them very flexible for manipulating 
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the signals that they represent. One of the most important properties of the DFT is 
that periodic convolution of two finite-length sequences corresponds to multiplication 
of their corresponding DFTs. We have seen in Section 8.7 that it is possible to exploit 
this property to compute linear convolutions by doing only DFT computations. In the 
case of the DCT, the corresponding result is that multiplication of DCTs corresponds 
to periodic convolution of the underlying symmetrically extended sequences. However, 
there are additional complications. For example, the periodic convolution of two Type-2 
symmetric periodic sequences is not a Type-2 sequence, but rather, a Type-1 sequence. 
Alternatively, periodic convolution of a Type-1 sequence with a Type-2 sequence of 
the same implied period is a Type-2 sequence. Thus, a mixture of DCTs is required 
to effect periodic symmetric convolution by inverse transformation of the product of 
DCTs. There are many more ways to do this because we have many different DCT 
definitions from which to choose. Each different combination would correspond to pe- 
riodic convolution of a pair of symmetrically extended finite sequences. Martucci (1994) 
provides a complete discussion of the use of DCT and DST transforms in implementing 
symmetric periodic convolution. 

Multiplication of DCTs corresponds to a special type of periodic convolution that 
has some features that may be useful in some applications. As we have seen for the DFT, 
periodic convolution is characterized by end effects, or "wrap around" effects. Indeed, 
even linear convolution of two finite-length sequences has end effects as the impulse 
response engages and disengages from the input. The end effects of periodic symmetric 
convolution are different from ordinary convolution and from periodic convolution as 
implemented by multiplying DFTs. The symmetric extension creates symmetry at the 
endpoints. The "smooth" boundaries that this implies often mitigate the end effects 
encountered in convolving finite-length sequences. One area in which symmetric con- 
volution is particularly useful is image filtering, where objectionable edge effects are 
perceived as blocking artifacts. In such representations, the DCT may be superior to 
the DFT or even ordinary linear convolution. In doing periodic symmetric convolution 
by multiplication of DCTs, we can force the same result as ordinary convolution by 
extending the sequences with a sufficient number of zero samples placed at both the 
beginning and the end of each sequence. 



8.9 SUMMARY 

In this chapter, we have discussed discrete Fourier representations of finite-length se- 
quences. Most of our discussion focused on the discrete Fourier transform (DFT), which 
is based on the discrete Fourier series representation of periodic sequences. By defining 
a periodic sequence for which each period is identical to the finite-length sequence, the 
DFT becomes identical to one period of the discrete Fourier series coefficients. Because 
of the importance of this underlying periodicity, we first examined the properties of dis- 
crete Fourier series representations and then interpreted those properties in terms of 
finite-length sequences. An important result is that the DFT values are equal to samples 
of the z-transform at equally spaced points on the unit circle. This leads to the notion of 
time aliasing in the interpretation of DFT properties, a concept we utilized extensively 
in the study of circular convolution and its relation to linear convolution. We then used 
the results of this study to show how the DFT could be employed to implement the 
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linear convolution of a finite-length impulse response with an indefinitely long input 
signal. 

The chapter concluded with an introduction to the discrete cosine transform. It 
was shown that the DCT and DFT are closely related and that they share an implicit 
assumption of periodicity. The energy compaction property, which is the main reason 
for the popularity of the DCT in data compression, was demonstrated with an example. 



PROBLEMS 



Basic Problems with Answers 

8.1. Suppose x c (t) is a periodic continuous-time signal with period 1 ms and for which the 
Fourier series is 



:(0-E 



a k e 



jiinkt/ur 3 ) 



k=-9 



The Fourier series coefficients a^ are zero for \k\ > 9. x c (t) is sampled with a sample spacing 
T = jr x 10 -3 s to form x[n]. That is, 



x[n] — x c 



nlQ~ 



(a) Is x[n] periodic and, if so, with what period? 

(b) Is the sampling rate above the Nyquist rate? That is, is T sufficiently small to avoid 
aliasing? 

(c) Find the discrete Fourier series coefficients of x[n] in terms of a^. 

8.2. Suppose x[n] is a periodic sequence with period N. Then x[n] is also periodic with period 3 N. 
Let X[k] denote the DFS coefficients of x[n] considered as a periodic sequence with period 
N, and let X^[k] denote the DFS coefficients of x[n] considered as a periodic sequence with 
period 3N. 

(a) Express Xt, [k] in terms of X[k]. 

(b) By explicitly calculating X[k] and X3 [k], verify your result in Part (a) when x[n] is as 
given in Figure P8.2-1. 



x[n],N=2 



1 1 1 i II II '1 



2t 2? 



-2-101 234567 



n Figure P8.2-1 



8.3. Figure P8.3-1 shows three periodic sequences x\[n] through X3[n]. These sequences can be 
expressed in a Fourier series as 



1 N ~ l 
x[n] = ~^2x[k]e^ 2 ^ N ^ kn . 

k=0 
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(a) For which sequences can the time origin be chosen such that all the X[k] are real? 

(b) For which sequences can the time origin be chosen such that all the X[k] (except for k 
an integer multiple of N) are imaginary? 

(c) For which sequences does X[k] = for k = ±2, ±4, ±6? 



*i[«] 



-• — • — • — •- 



♦ t ♦ * 



x~> \n\ 



hi n ] 



• • • • f T T ° 

— — — — — I — I — I — I — — — — — I — I — I — I — — — — 

o i 4 4 i nnjo 



Figure P8.3-1 



8.4. Consider the sequence x[n] given by x[n] = a n u[n]. A periodic sequence x[n] is constructed 
from x[n] in the following way: 



x[n] = V^ x[n + rN]. 



(a) Determine the Fourier transform X(e ico ) of x[n]. 

(b) Determine the discrete Fourier series X[k] of x[n]. 

(c) How is X[k] related to X(ei°>) ( > 

8.5. Compute the DFT of each of the following finite-length sequences considered to be of 
length TV (where Wis even): 

(a) x[n] = %], 

(b) x[n] = S[n - n ], < n < N- 1, 

1, n even, < n < N — 1, 
0, nodd, 0<n< N-\, 



(c) x[n] = 

(d) x[n] = 

(e) x[n] = 



1, 0<n< N/2-1, 
0, N/2<n<N-l, 



0<rt < N-l. 
otherwise. 
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8.6. Consider the complex sequence 



x[n] = 



e jmn , 0<n<N-l, 
0, otherwise. 



(a) Find the Fourier transform X(e iw ) of x[n]. 

(b) Find the TV-point DFT X[k] of the finite-length sequence x[n]. 

(c) Find the DFT of x[n] for the case ojq = Ink^/N, where ky is an integer. 

8.7. Consider the finite-length sequence x[n] in Figure P8.7-1. Let X(z) be the z-transform of 
x[n]. If we sample X(z) at z = e' {2n/4)k , k = 0, 1, 2, 3, we obtain 

*i[*] = *MU,<2,,4,*. * = 0,1,2,3. 
Sketch the sequence jci [n] obtained as the inverse DFT of X\ [k]. 



-3 -2-1 1 



Figure P8.7-1 



8.8. Let X{e^°) denote the Fourier transform of the sequence x[n] — (\) u[ri\. Let y[n] denote 
a finite-duration sequence of length 10; i.e., y[n] = 0, n < 0, and y[n] = 0, n > 10. The 
10-point DFT of y[n], denoted by Y [k], corresponds to 10 equally spaced samples of X(e^ co )\ 
i.e., Y[k] = X(eJ 27lk / ]l) ). Determine y[n]. 

8.9. Consider a 20-point finite-duration sequence x[n] such that x[n] = outside < n < 19, 
and let X(e^ co ) represent the Fourier transform of x[n]. 

(a) If it is desired to evaluate X(e^ ( °) at co = An/S by computing one M-point DFT, 
determine the smallest possible M, and develop a method to obtain X(e^ w ) at id — Anl5 
using the smallest M. 

(b) If it is desired to evaluate X(e^ <0 ) at en — \0tt/21 by computing one L-point DFT, 
determine the smallest possible L, and develop a method to obtain X(e^ 0n/21 ) using 
the smallest L. 

8.10. The two eight-point sequences x\[n] and X2[n] shown in Figure P8.10-1 have DFTs X\[k\ 
and A^[/c], respectively. Determine the relationship between X\[k] and A^/c]. 

x x [n] 
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x 2 [n] 



Figure P8.10-1 



8.11. Figure P8.11-1 shows two finite-length sequences x\[n] and X2[n]. Sketch their six-point 
circular convolution. 
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Figure P8. 11-1 



8.12. Suppose we have two four-point sequences x[n] and h\n] as follows: 



x[n] = cos(™j 
h[n] = 2". 



n = 0, 1.2.3, 
« = 0, 1.2.3. 



(a) Calculate the four-point DFT X[k\. 

(b) Calculate the four-point DFT H[k]. 

(c) Calculate y[n] = .v[m] (4) /?[/?] by doing the circular convolution directly. 

(d) Calculate y[n] of Part (c) by multiplying the DFTs of x[n] and h[n] and performing an 
inverse DFT. 

8.13. Consider the finite-length sequence x[n] in Figure P8.13-1. The five-point DFT of x[n] is 
denoted by X[k]. Plot the sequence y[n] whose DFT is 

Y[k] = W~ 2k X[k]. 



LA 



-2 -l o l 2 3 4 5 6 7 « Figure P8. 13-1 

8.14. Two finite-length signals, X[[n] andx:[n]. are sketched in Figure P8.14-1. Assume that jri[n] 
and X2[n] are zero outside of the region shown in the figure. Let x^[n] be the eight-point 
circular convolution of x\ [n] with X2[n]; i.e., XT>[n] — X] [n](§)x2[n]. Determine xt,[2]. 
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Figure P8.14-1 



8.15. Figure P8.15-1 shows two sequences x\[n\ and j^M- The value of X2[n] at time n — 3 is 
not known, but is shown as a variable a. Figure P8.15-2 shows y[n], the four-point circular 
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convolution of x\[n] and j^M- Based on the graph of y[n], can you specify a uniquely? If 
so, what is a? If not, give two possible values of a that would yield the sequence y[n] as 
shown. 



tl 
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*i \n\ 



-1 1 



x 2 [n] 



Figure P8.15-1 
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Figure P8.15-2 



8.16. Figure P8.16-1 shows a six-point discrete-time sequence x[n]. Assume that x[n] = outside 
the interval shown. The value of x[4] is not known and is represented as b. Note that the 
sample shown for b in the figure is not necessarily to scale. Let X(e^ co ) be the DTFT of x[n] 
and X\[k] be samples of X{e^ u> ) every n/2; i.e., 

X l [k\ = X{en\ a={nmkt 0</:<3. 

The four-point sequence jci [n] that results from taking the four-point inverse DFT of X\ [k] 
is shown in Figure P8.16-2. Based on this figure, can you determine b uniquely? If so, give 
the value for b. 
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Figure P8.16-1 
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Figure P8.16-2 



8.17. Figure P8.17-1 shows two finite-length sequences x\ [n] and X2[n], What is the smallest jVsuch 
that the Appoint circular convolution of x\[n] and X2[n] are equal to the linear convolution 
of these sequences, i.e., such that x\[n] (N)*2[/t] = x\[n] * X2M? 
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Figure P8.17-1 



8.18. Figure P8.18-1 shows a sequence x[n] for which the value of x[3] is an unknown constant c. 
The sample with amplitude c is not necessarily drawn to scale. Let 

Xx[k] = X[k]e> 2jI * k/ \ 

where X[k] is the five-point DFT of x[n]. The sequence xi[n] plotted in Figure P8.18-2 is 
the inverse DFT of X\ [k]. What is the value of c? 
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Figure P8.18-1 
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Figure P8.18-2 



8.19. Two finite-length sequences x[n] and xi[n] are shown in Figure P8.19-1. The DFTs of these 
sequences, X[k] and ^i[A:], respectively, are related by the equation 



Xi[k] = X[k]e' 



-j(27Tkm/6) 



where m is an unknown constant. Can you determine a value of m consistent with Fig- 
ure P8.19-1? Is your choice of m unique? If so, justify your answer. If not, find another 
choice of m consistent with the information given. 
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Figure P8.19-1 



8.20. Two finite-length sequences x[n] and x\ [n] are shown in Figure P8.20-1. The Appoint DFTs 
of these sequences, X[k] and X\ [k], respectively, are related by the equation 

Xi[k] = X[k]e' 2irk2/N , 

where N is an unknown constant. Can you determine a value of N consistent with Fig- 
ure P8.20-1? Is your choice for N unique? If so, justify your answer. If not, find another 
choice of /V consistent with the information given. 
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Figure P8.20-1 



Basic Problems 

8.21. (a) Figure 8.21-1 shows two periodic sequences, Jti [n] and X2[n], with period N = 7. Find a 
sequence y\[n] whose DFS is equal to the product of the DFS of x\[n] and the DFS of 
x 2 [n],i.e., 



Y,[k] = X x [k)X 2 [k\ 
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Figure P8.21-1 



(b) Figure 8.21-2 shows a periodic sequence xj[n] with period N = 7. Find a sequence y2[n] 
whose DFS is equal to the product of the DFS of x\ [n] and the DFS of Xi[n], i.e.. 



Y 2 [k] = X l [k]Xs[k]. 



.* 3 [n] 
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Figure P8.21-2 



8.22. x[n] denotes a finite-length sequence of length N. Show that 

x[((-n)) N ]=x[((N~n)) N ]. 

8.23. Consider a finite-duration sequence x[«] of length P such that x[«] = Ofor/? < 0and/7 > P. 
We want to compute samples of the Fourier transform at the N equally spaced frequencies 



<*>k = 



Ink 

~N~' 



k = Q, 1 N-l. 



Determine and justify procedures for computing the jV samples of the Fourier transform 
using only one N-point DFT for the following two cases: 

(a) N > P. 

(b) N < P. 

8.24. Consider a real finite-length sequence x[n] with Fourier transform X(e^) and DFT X[k]. 
If 

Jm{X[k]} = 0, k = Q,l,...,N-l, 
can we conclude that 

Jm[X(e jo> )} = 0, -it < co < n? 

State your reasoning if your answer is yes. Give a counterexample if your answer is no. 
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8.25. Consider the finite-length sequence x[n] in Figure P8.25-1. The four-point DFT of x[n] is 
denoted X[k\. Plot the sequence y[n] whose DFT is 

Y[k] = Wl k X[k\. 



3/4 



x[n] 



1/2 
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T 



-2-1012345678 " Figure P8.25-1 
8.26. Consider the real finite-length sequence x[n] shown in Figure P8.26-1. 

x[n\ 



r . . . 



2-10123456 « Figure P8.26-1 

(a) Sketch the finite-length sequence y[n] whose six-point DFT is 

Y[k] = Wt k X[kl 

where X[k] is the six-point DFT of x[n]. 

(b) Sketch the finite-length sequence w[n] whose six-point DFT is 

W[k] = lZe{X[k]}. 

(c) Sketch the finite-length sequence q[n] whose three-point DFT is 

Q[k] = X[2k], Jt = 0,1,2. 
8.27. Figure P8.27-1 shows two sequences, 

' 1, 0<n<99, 



and 



xi[n] = 
x 2 [n] = 



0, otherwise, 

1, 0<n<9, 
0, otherwise. 
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Figure P8.27-1 
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(a) Determine and sketch the linear convolution jci [n] * xi[n\. 

(b) Determine and sketch the 100-point circular convolution x\ [n] (100) xi [n] 

(c) Determine and sketch the 110-point circular convolution x\ [n] (fio) X2 [n] 
8.28. Figure P8.28-1 shows a finite-length sequence x[n]. Sketch the sequences 



and 



X] [n] = jc[((w-2)) 4 ]. 0</7 <3. 
xi[n] = x[{{-n)) A l < n < 3. 



6 5 
T t 4 



It... 



12 3 



x[n\ 



Figure P8.28-1 



8.29. Figure P8.29-1 shows two finite-length sequences. Sketch their jV-point circular convolution 

for N = 6 and for N = 10. 



5 
* 4 



3 
t 2 



12 3 4 5 



*it«] 



x 2 [«] 



1 1 



T T . . . 



Figure P8.29-1 



Advanced Problems 

8.30. Consider a finite-length sequence x[n] of length N\ i.e., 

x[n] = outside < « < N" — 1. 

X(e^ ai ) denotes the Fourier transform of x[n\. X[k] denotes the sequence of 64 equally 
spaced samples of X(e^ w ), i.e., 

X[k\ = X(e^)L =2 ^ /64 . 

It is known that in the range < k < 63, X[32] = 1 and all the other values of X[k] are 
zero. 

(a) If the sequence length is jV = 64, determine one sequence x[n] consistent with the 
given information. Indicate whether the answer is unique. If it is, clearly explain why. 
If it is not, give a second distinct choice. 

(b) If the sequence length is N = 192 = 3 x 64, determine one sequence x[n] consistent 
with the constraint that in the range < k < 63, A!" [32] = 1 and all other values in that 
range are zero. Indicate whether the answer is unique. If it is, clearly explain why. If it 
is not, give a second distinct choice. 
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8.31. The DFT of a finite-duration sequence corresponds to samples of its z-transform on the 
unit circle. For example, the DFT of a 10-point sequence x[n] corresponds to samples of 
X{z) at the 10 equally spaced points indicated in Figure P8.31-1. We wish to find the equally 
spaced samples of X(z) on the contour shown in Figure P8.31-2; i.e., we wish to obtain 



^(£)|- = ()_5 £ ,y[(2.T*/i«> + (:r/IO 



>i- 



Show how to modify x[n] to obtain a sequence x\ [n] such that the DFT of *i [n] corresponds 
to the desired samples of X(z). 



z-plane 




Figure P8.31-1 



Circle with 
radius = 



/ z-plane 

2tt 




Figure P8.31-2 



8.32. A finite-duration sequence x[n] of length 8 has the eight-point DFT X[k] shown in Fig- 
ure P8.32-1. A new sequence of length 16 is defined by 



y[n] = 



x[n/2], n even, 
0, ttodd. 



From the list in Figure P8.32-2, choose the sketch corresponding to Y[k], the sixteen-point 
DFT of ^[n]. 



1 


> 
1 


> 




i 


X[k] 


• — • — • — 




1 


* ■ 

T . T 


i 


— • — • — • 



12 3 4 5 6 7 



Figure P8.32-1 
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Tt.rT 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 



(a) 



Li 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 



(b) 



1t.t11H1t.t1 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 
(c) 



lift . tM 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 
(d) 



l .. l .l.l 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 
(e) 



mh 



u 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 



(0 



Figure P8.32-2 



8.33. Consider a finite-length sequence x[n] of length N as indicated in Figure P8.33-1. (The solid 
line is used to suggest the envelope of the sequence values between and N — 1.) Two 
finite-length sequences x\ [n] and xi[n\ of length 2 N are constructed from x[n] as indicated 
in Figure P8.33-2, with x\[n] and X2[n] given as follows: 



xi[n] = 



x 2 [n] = 



x[n], 0<n<N-l, 
0, otherwise, 

x[n], <n < N-l, 

-x[n-N], N <n <2N-1, 
0, otherwise. 
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The N-point DFT of x[n] is denoted by X[k], and the 2iV-point DFTs of x\[n] and X2[n] 
are denoted by X\[k] and X2 [k], respectively. 




N-l 



Figure P8.33-1 



*i[n] 



N-l 



(a) 



2N-1 



N 



2N-1 



x 2 [n] 



N-l 



(b) Figure P8.33-2 

(a) Specify whether X2[k] can be obtained if X[k] is given. Clearly indicate your reasoning, 

(b) Determine the simplest possible relationship whereby one can obtain X[k] from X\ [k]. 

8.34. The even part of a real sequence x[n] is defined by 



x e [n] = 



x[n] + x[~n] 



Suppose that x[n] is a real finite-length sequence defined such that x[n] = for n < and 
n > N. Let X[k] denote the JV-point DFT of x[n]. 

(a) lsTZe{X[k]}theDFTofx e [n]1 

(b) What is the inverse DFT of Ke{X[k]} in terms of *[«]? 

8.35. Determine a sequence x[n] that satisfies all of the following three conditions: 
Condition 1: The Fourier transform of x[n] has the form 

X{e )a} ) = 1 + A\ cos to + A2 cos 2ft>, 

where A\ and Ai are some unknown constants. 

Condition 2: The sequence *[«]*<$[« — 3] evaluated at ai = 2 is 5. 

Condition 3: For the three-point sequence w[n] shown in Figure P8.35-1, the result of the 
eight-point circular convolution of w[n] and x[n — 3] is 11 when n = 2; i.e., 



^w[m]x[((«-3-m)) 8 ] 



m=0 



= 11. 



M=2 
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♦ 3 



r 



w[n] 



Figure P8.35-1 



8.36. Consider the finite-length sequence 



x[n] = 2S[n] + S[n - 1] + 8[n - 3]. 

We perform the following operation on this sequence: 
(i) We compute the five-point DFT X[k]. 
(ii) We compute a five-point inverse DFT of Y [k] — X[k) 2 to obtain a sequence y[n]. 

(a) Determine the sequence y[n] for n = 0, 1, 2, 3, 4. 

(b) If iV-point DFTs are used in the two-step procedure, how should we choose /V so 
that y[n] ~ x[n]*x[n] for < n < N - 1? 

8.37. Consider a finite-duration sequence x[n] that is zero for n < and n > N, where N is even. 
The z-transform of x[n] is denoted by X{z). Table P8.37-1 lists seven sequences obtained 
from x[ri\. Table P8.37-2 lists nine sequences obtained from X(z). For each sequence in 
Table P8.37-1, find its DFT in Table P8.37-2. The size of the transform considered must be 
greater than or equal to the length of the sequence gk[n]. For purposes of illustration only, 
assume that x[n] can be represented by the envelope shown in Figure P8.37-1. 



x[n] 



TABLE P8.37-1 



#-1 n Figure P8.37-1 



gl [n]=x[N-l-n] 



g 2 [n] = (~\rx[n] 



x[n], 0<n<N~l, 

83[n] = i x[n-N], N<n<2N-l, 
0, otherwise 



A 


1 L iJ J 






/ 






A ii 


N 
g 2 [n] 


- 1 n 




\ 




A 


/ 


N - in 


g 3 [n] 






X 


> 




N - 


- 1 

( 


2N - 1 n 
Continued ) 
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TABLE P8.37-1 (Continued) 



#4" J = 



x[n] + x[n + N/2\, < n < N/2 - 1, 
0. otherwise 



2A 



g 4 M 



N 



#>["! = 



8h[n\ = 



x\n]. i)<n<N-\, 

0. N <n <2N- ], 

0. otherwise 



,v[«/2J. ti even, 
0, n odd 



g 7 [n] = x[2n] 



g>] 



g» 



i 



N - 1 2N - 1 n 



8 7 [n] 



N 

2 



2N - 1 n 



TABLE P8.37-2 



H\\k] 


= X{e^ nk ' s ) 




H 2 [k] 


= X{e' 2:Tk ' 2S ) 




Hi[k] 


f 2AV 2 **' 2 ' V ). 
I ' 


k even. 
£odd 


Hi[k] 


= X(e j27Tk/{2N ~ [} ) 




H 5 [k] 


= 0.5{X(eJ 2 " k ' s ') + X(e> 2 ^ k+ ^W)} 


H h [k] 


= X{e^ kis ) 




Hf[k] 


_ e J27Tk/.\x( e -j2zk/, 


V ) 


H«[k) 


= X(e' i27l/N)ik+N/2) 


) 


H 9 [k] 


= X(e-! 2 ^ N ) 





8.38. x[n] is a real-valued finite-length sequence of length 10 and is nonzero in the interval from 
to 9, i.e., 

x[n] = 0, n<0.«>10, 

x[n] / 0. < n < 9. 

X{e^ Q} ) denotes the Fourier transform of x[n], and X[k] denotes the 10-point DFT of x[n]. 
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Determine a choice for x [n] so that X[k] is real valued for all k and 

X(ei<°) = A{a))ei aw , M <tt, 

where A(co) is real and a is a nonzero real constant. 

8.39. Two finite-length sequences*] [n] and X2[n\, which are zero outside the interval < n < 99, 
are circularly convolved to form a new sequence y[n]\ i.e., 

99 

y[n] = x l [n)@x 2 [n} = ^ jc, [*]* 2 [((n - *))ioo], < /i < 99. 



*=o 



If, in fact, x\[n] is nonzero only for 10 < n < 39, determine the set of values of n for which 
y[n] is guaranteed to be identical to the linear convolution of x\ [n] and X2[n). 

8.40. Consider two finite-length sequences x[n] and h[n] for which x[n] = outside the interval 
< n < 49 and ^i[/i] = outside the interval < « < 9. 

(a) What is the maximum possible number of nonzero values in the linear convolution of 
x[n] and h[n]7 

(b) The 50-point circular convolution of x[n] and h[n] is 

x[n]®h[n]~ 10, < w < 49. 
The first 5 points of the //«£#/■ convolution of x[n] and ^[/?] are 

x[/?] */i[ai] = 5, < « < 4. 

Determine as many points as possible of the linear convolution of x[n] * n[n\. 

8.41. Consider two finite-duration sequences x[n] and ^[/t]. Jt[/i] is zero for n < 0, n > 40, and 
9 < /i < 30, and jy[/i] is zero for n < 10 and « > 19, as indicated in Figure P8.41-1. 

x[n] 




30 



(a) 



39 n 



y[n] 



10 19 

(b) 



Figure P8.41-1 



Let w[n] denote the linear convolution of x[n] and y[n]. Let g[n] denote the 40-point circular 
convolution of x[n] and y[n]: 



w 



[n] = x[n\ * y[n] = \ x[k]y[n — k]. 



k=—oc 
39 



g[n] = x[n]@y[n] = £*[*]>[((/! - k)U]. 



fc=0 



(a) Determine the values of n for which w[n] can be nonzero. 

(b) Determine the values of n for which w[n] can be obtained from g[n]. Explicitly specify 
at what index values n in g\n\ these values of w\n\ appear. 



616 



The Discrete Fourier Transform Chap. 8 



8.42. Two finite-duration sequences h][n] and fi2[n\ of length 8 are sketched in Figure P8.42-1. 
The two sequences are related by a circular shift, i.e., h\[n\ — fi2[((n — m))s]. 



1 

..T 


• 


< 
> 


> < 


> 




< 

— ' — • — • — • — • — 



12 3 4 5 6 7 
(a) 



11 



h 2 \n) 



12 3 4 5 6 7 



(b) 



-• — • — • — •- 



Figure P8.42-1 



(a) Specify whether the magnitudes of the eight-point DFTs are equal. 

(b) We wish to implement a lowpass FIR filter and must use either h\[n] or /12M as the 
impulse response. Which one of the following statements is correct? 

(i) h\[n\ is a better lowpass filter than fi2[n]. 
(ii) fi2[n] is a better lowpass filter than h\[n]. 
(iii) The two sequences are both about equally good (or bad) as lowpass filters. 

8.43. We want to implement the linear convolution of a 10,000-point sequence with an FIR 
impulse response that is 100 points long. The convolution is to be implemented by using 
DFTs and inverse DFTs of length 256. 

(a) If the overlap-add method is used, what is the minimum number of 256-point DFTs and 
the minimum number of 256-point inverse DFTs needed to implement the convolution 
for the entire 10,000-point sequence? Justify your answer. 

(b) If the overlap-save method is used, what is the minimum number of 256-point DFTs and 
the minimum number of 256-point inverse DFTs needed to implement the convolution 
for the entire 10,000-point sequence? Justify your answer, 

(c) We will see in Chapter 9 that when Nisa power of 2, an N-point DFT or inverse DFT 
requires (N/2)\og 2 N complex multiplications and jVlog 2 N complex additions. For 
the same filter and impulse response length considered in Parts (a) and (b), compare 
the number of arithmetic operations (multiplications and additions) required in the 
overlap-add method, the overlap-save method, and direct convolution. 

8.44. Let X\[n] be a sequence obtained by expanding the sequence x[n] = (5) u[n] by a factor 
of 4; i.e, 



xi 



L J \ 0, othe: 



k = 0, ±4, ±8, 



otherwise. 



Find and sketch a six-point sequence q[n] whose six-point DFT Q[k] satisfies the two con- 
straints 

Q[0] - *i(l), 
where X\(z) represents the z-transform of x\\n\. 
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8.45. Let X2[n] be a real-valued five-point sequence whose seven-point DFT is denoted by A^t&J. 
If Realist/:]} is the seven-point DFT of g[n], show that g[0] = ^[0], and determine the 
relationship between g[l] and *2[1]. Justify your answer. 

8.46. Shown in Figure P8.46-1 are three finite-length sequences of length 5. X,{e }<ii ) denotes the 
DTFT of Xi[n], and Xi[k\ denotes the five-point DFT of *,-[«]. For each of the following 
properties, indicate which sequences satisfy the property and which do not. Clearly justify 
your answers for each sequence and each property. 

(i) Xi [k] is real for all k. 

(ii) Xi{e^) — Aj((o)ei a,aJ , where Ai(co) is real and or, is constant, 
(iii) Xj[k] = B\U\e jY,k where B\U\ is real and ]/,- is a constant. 



o 1 

3 



1 



t2 



f 2 



r I r 



2 3 4 



2 3 4 



f2 



2 3 4 



x\n\ 



1 


>3 

< 


•2 


•2 




x ii n ] 




!' 




( 


»1 





x A n \ 



Figure P8.46-1 



8.47. Let 

x[n] = 0, n < 0, n > 7, 
be a real eight-point sequence, and let X[k] be its eight-point DFT. 



(a) Evaluate 



-^2x[k]e^^ k " 



k=Q 



n=9 



in terms of x[n]. 

(b) Let 

v[n] = 0, n < 0, n > 7, 

be an eight-point sequence, and let V[k] be its eight-point DFT. 

If V[k] = X(z) at z = 2exp(y(2^ + jt)/8) for A: = 0, . . . , 7, where X(z) is the 

z-transform of x[n], express v[n] in terms of x[n]. 

(c) Let 

w[n] = 0, m < 0, n > 3 

be a four-point sequence, and let W[k] be its four-point DFT. 
If W[k] = A^A:] + X[k + 4], express w[«] in terms of *[«]. 
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(d) Let 

y[n] = 0, n < 0, n > 7, 

be an eight-point sequence, and let Y[k] be its eight-point DFT. 
If 

(2X[kl * = 0,2.4,6, 
nj ~\ 0, £=1,3.5,7, 

express y[n] in terms of x[n], 

8.48. (a) Suppose 

jc[/i] = 0, w <0, n> (yV- 1), 

is an A/- point sequence having at least one nonzero sample. Is it possible for such a 
sequence to have a DTFT 

X(e i2nk/M ) = 0, k = 0, 1 M - ] , 

where M is an integer greater than or equal to N? If your answer is yes, construct an 
example. If your answer is no, explain your reasoning. 
(b) Suppose M < N. Repeat Part (a). 

8.49. Suppose x\[ri\ is an infinite-length, stable (i.e., absolutely summable) sequence with 
z-transform given by 

Suppose X2[n] is a finite-length sequence of length TV, and the jY-point DFT of X2[n] is 

AT 2 [*] = *i(z)| z=ifWV , * = <U *-l- 

Determine JC2[«]. 

8.50. Read each part of this problem carefully to note the differences among parts. 
(a) Consider the signal 

' 1 + cos(t™/4) - 0.5 cos(37rn/4), < n < 7, 



x\n] = w . , 

1 '0, otherwise, 

which can be represented by the IDFT equation as 

{ 0, otherwise, 

where X H [k] is the eight-point DFT of x[n]. Plot X»[k] for < k < 7. 

(b) Determine V 16 [£], the sixteen-point DFT of the sixteen-point sequence 

ri f l + cos(7r«/4) -0.5cos(3jrrt/4), < n < 15, 
v[n] = < n ' ' .r T 

L 10, otherwise. 

Plot V ]6 [k] for 0< fc< 15. 

(c) Finally, consider | A^f/c]!, the magnitude of the sixteen-point DFT of the eight-point 
sequence 

' 1 + cos(7rn/4) - 0.5 cos(37T«/4), < n < 7, 



^ 1 0, otherwise. 

Sketch |Xi6[A:]| for < k < 15 without explicitly evaluating the DFT expression. You 
will not be able to find all values of [Jf^A:]! by inspection as in Parts (a) and (b), but 
you should be able to find some of the values exactly. Plot all the values you know 
exactly with a solid circle, and plot estimates of the other values with an open circle. 
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Extension Problems 

8.51. In deriving the DFS analysis equation (8.11), we used the identity of Eq. (8.7). To verify 
this identity, we will consider the two conditions k — r = mN and k~- r ^ mN separately. 
(a) For k ~ r = mN, show that e i(^/N)(k~r)n = x andi from this ^ that 



_ V" e J{2n/N)(k-r)n = { f Q Tk-r = mN. 



n=0 



Since k and r are both integers in Eq. (8.7), we can make the substitution k — r = t and 
consider the summation 



N- 1 , N- 1 



n=() #1=0 

Because this is the sum of a finite number of terms in a geometric series, it can be 
expressed in closed form as 

1 ^ ,,^,^.. 1 l-e>l 2 *' N > tN 






;i=() 



(b) For what values of t is the right-hand side of this equation indeterminate? That is, are 
the numerator and denominator both zero? 

(c) From the result in Part (b), show that if k — r ^ mN, then 



N ^ 

8.52. In Section 8.2, we stated the property that if 

x\[n] = x[n — m], 

then 

X x [k] = W k N >»X[k], 

where X[k] and X\ [k] are the DFS coefficients of x[n] and x\ [/?], respectively. In this prob- 
lem, we consider the proof of that property. 

(a) Using Eq. (8.11) together with an appropriate substitution of variables, show that X\ [k] 
can be expressed as 

Xi[k] = W k N m ]T xVVNn- (P8.52-1) 

r=—m 

(b) The summation in Eq. (P8.52-1) can be rewritten as 

N-l-m -1 N-\-m 

Y, ~ x ^ W n= ]T>[']< r + E ~ X W W N- (P8.52-2) 

r=—m r——m r— 

Using the fact that *[/■] and Wj§ r are both periodic, show that 

-1 jV-1 

]T ~x[r)K r = ]T X W W *- (P8.52-3) 

r=—m r—N—m 
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(c) From your results in Parts (a) and (b), show that 

N~l 

8.53. (a) Table 8.1 lists a number of symmetry properties of the discrete Fourier series for pe- 
riodic sequences, several of which we repeat here. Prove that each of these properties 
is true. In carrying out your proofs, you may use the definition of the discrete Fourier 
series and any previous property in the list, (For example, in proving property 3, you 
may use properties 1 and 2.) 



Sequence 


Discrete Fourier Series 


1 x*[n] 


X*[-k] 


2. r[-«] 


X*[k] 


3. 7£e {*[«]} 


X e [k] 


4. jjm{x[n]} 


X<,[k] 



(b) From the properties proved in Part (a), show that for a real periodic sequence x[n], the 
following symmetry properties of the discrete Fourier series hold: 

1. Tle{X[k]} = Ke[X[-k]) 

2. Jm{X[k]} = -Jm{X[-k]} 

3. \X[k]\ = \X[-k]\ 

4. <X[k] = -<X[-k] 

8.54. We stated in Section 8.4 that a direct relationship between X{e^") and X[k] can be derived, 
where X[k] is the DFS coefficients of a periodic sequence and X(e^'°) is the Fourier trans- 
form of one period. Since X[k] corresponds to samples of X(eJ w ), the relationship then 
corresponds to an interpolation formula. 

One approach to obtaining the desired relationship is to rely on the discussion of 
Section 8.4, the relationship of Eq. (8.54), and the modulation property of Section 2.9.7. 
The procedure is as follows: 

1. With X[k\ denoting the DFS coefficients of x[n], express the Fourier transform 
X{e ]0) ) of x[n] as an impulse train. 

2. From Eq. (8.57), x[n] can be expressed as x[n] — x\n\w\n\, where w[n] is an appro- 
priate finite-length window. 

3. Since x[n] = x[n]w[n], from Section 2.9.7, X{e^ w ) can be expressed as the (periodic) 
convolution of X{e>°>) and W(e JQ} ). 

By carrying out the details in this procedure, show that X{e* w ) can be expressed as 

X(e^) -iV x\k\ ""[M'- 2 **)/ 2 ] c -i\(N-\)ma>-2*vm 

A(e >- N2^ X ^sin{[ ( o~(2jrk/N)]/2} e 

Specify explicitly the limits on the summation. 

8.55. Let X[k] denote the jV-point DFT of the Appoint sequence x[n]. 

(a) Show that if 

x[n] = — x[N — 1 — n], 

then X[0] = 0. Consider separately the cases of TV even and N odd. 

(b) Show that if N is even and if 

x[n] — x[N — 1 — «], 

then X[N/2] = 0. 
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8.56. In Section 2.8, the conjugate-symmetric and conjugate-antisymmetric components of a se- 
quence x[n] were defined, respectively, as 

x e \n] = -(x[n] + x*[-n]), 

x [n]= l -(x[n]-x*[-n]). 

In Section 8.6.4, we found it convenient to respectively define the periodic conjugate- 
symmetric and periodic conjugate-antisymmetric components of a sequence of finite dura- 
tion TV as 

* ep M = 3M((*))n] + **[((-"))*])< < n < N - 1, 

*o P M = £{*[((«))*] ~ **[((-"))"]). Q<n<N-l. 

(a) Show that -*r e p[«] can be related to x e [n] and that * p[«] can be related to x, t [n] by the 
relations 

x ep [n] = (x e [n] + x e [n - TV]) , < /i < TV - 1, 

x op [n) = (x [n] + x () [n - N]), < /z < TV - 1 . 

(b) x[n] is considered to be a sequence of length TV, and in general, x e [n] cannot be re- 
covered from -*r ep [«], and x„[n] cannot be recovered from jr op [/t]. Show that with x[n] 
considered as a sequence of length TV, but with x[n] ~ 0, n > TV/2, x e [n] can be obtained 
from x cp [/7], and x () [n\ can be obtained from x op [«]. 

8.57. Show from Eqs. (8.65) and (8.66) that with x[n] as an TV-point sequence and X[k] as its 
TV-point DFT, 

N-l . JV-1 



][>MI 2 = ^ Jjat[*]i : 



> I j\ I K I 

TV 

n=0 k=0 



This equation is commonly referred to as ParsevaVs relation for the DFT. 

8.58. x[n] is a real-valued, nonnegative, finite-length sequence of length N; i.e., x[n] is real and 
nonnegative for < n < N — 1 and is zero otherwise. The TV-point DFT of x[n] is X[k], 
and the Fourier transform of x[n] is X(e^ a} ). 

Determine whether each of the following statements is true or false. For each state- 
ment, if you indicate that it is true, clearly show your reasoning. If you state that it is false, 
construct a counterexample. 

(a) If X{ei m ) is expressible in the form 

X{e i<a ) = B(co)e jaco , 
where B(co) is real and a is a real constant, then X[k] can be expressed in the form 

X[k) = A[k]eJ yk , 

where A[k] is real and y is a real constant. 

(b) If X[k] is expressible in the form 

X[k] = A[k]e Jyk , 
where A[k] is real and y is a real constant, then X(e^ w ) can be expressed in the form 

X(e' w ) = B{oj)e jaw , 
where B{a>) is real and a is a real constant. 
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8.59. x[n] and y[n] are two real- valued, positive, finite-length sequences of length 256; i.e., 

x[n] > T < n < 255, 
y[n] > 0, < n < 255, 
x[n] = y[n] = 0, otherwise. 

r[n] denotes the linear convolution of x[n] and y[n). R{eJ c0 ) denotes the Fourier transform 
of r[n\. R s [k] denotes 128 equally spaced samples of R{e ja} )\ i.e., 

R s [k] = R{en\^i,k/m, * = 0. 1 127. 

Given x[n] and y[n], we want to obtain R s [k] as efficiently as possible. The only modules 
available are those shown in Figure P8.59-1. The costs associated with each module are as 
follows: 

Modules I and II are free. 
Module III costs 10 units. 
Module IV costs 50 units. 
Module V costs 100 units. 



Module I 



s[n] 



+ x 

2~i s\n 



[n + 128r] 



(a) 



Module III 
s x [n] 



s 2 [n) 



III 



L_ 



127 



Zi s,[m]s 2 [M-wj] 



m = 
(C) 



Module II 



s[n] 



II 



1 0, otherwise 
(b) 



Module IV 



s 2 [n] 



IV 



2j S][m]s2[n-m] 



255 

2 

(d) 



Module V 



s[n] 



V 



127 






(e) 

Figure P8.59-1 

By appropriately connecting one or several of each module, construct a system for 
which the inputs are x[n\ and y[n] and the output is R s [k]. The important considerations 
are (a) whether the system works and (b) how efficient it is. The lower the total cost, the 
more efficient the system is. 

8.60. y[n] is the output of a stable LTI system with system function H(z) — \/{z — bz~ l ), where 
b is a known constant. We would like to recover the input signal x[n] by operating on y[n]. 
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The following procedure is proposed for recovering part of x[n] from the data y[n]: 

1. Using y[n], < n < N - 1, calculate Y[k], the TV-point DFT of y[n]. 

2. Form 

V[k] = (Wj k -bW* l )Y[k]. 

3. Calculate the inverse DFT of V[k] to obtain v[n]. 

For which values of the index n in the range n = 0, 1 N—l are we guaranteed that 

x[n] = v[n]l 

8.61. A modified discrete Fourier transform (MDFT) was proposed (Vernet, 1971) that com- 
putes samples of the z-transform on the unit circle offset from those computed by the DFT. 
In particular, with A^f/c] denoting the MDFT of x(n), 

X M [k] = X(z) , k = 0,1,2 N-l. 

Assume that N is even. 

(a) The jV-point MDFT of a sequence x[n] corresponds to the jV-point DFT of a sequence 
x\f [n], which is easily constructed from x[n]. Determine xm [n] in terms of x[n). 

(b) If x[n] is real, not all the points in the DFT are independent, since the DFT is conjugate 
symmetric; i.e., X[k] = X*[((— A:))a/] for < k < N — 1. Similarly, if x[n] is real, not 
all the points in the MDFT are independent. Determine, for x[n] real, the relationship 
between points in Xm [k\. 

(c) (i) Let R[k] = Xm [2A:]; that is, R[k] contains the even-numbered points in Xm [k]. 

From your answer in part (b), show that Xm [k] can be recovered from R[k]. 
(ii) R[k] can be considered to be the A//2-point MDFT of an jV/2-point sequence r\n\. 

Determine a simple expression relating r[n] directly to x[n]. 
According to Parts (b) and (c), the jV-point MDFT of a real sequence x[n] can be 
computed by forming r[n] from x[n] and then computing the jV/2-point MDFT of r \n\. 
The next two parts are directed at showing that the MDFT can be used to implement 
a linear convolution. 

(d) Consider three sequences x\\n\ xi\n\, and xy\n\ all of length N. Let X\m [k], Xim [k\, 
and Xim [k], respectively, denote the MDFTs of the three sequences. If 

X m [k} = X, M [k]X 1M [kl 

express x?\n\ in terms of x\\n\ and xi[n\. Your expression must be of the form of a 
single summation over a "combination" of x\ [n] and X2[n] in the same style as (but not 
identical to) a circular convolution. 

(e) It is convenient to refer to the result in Part (d) as a modified circular convolution. If the 
sequences *i [n] and X2[n] are both zero for n > N/2, show that the modified circular 
convolution of x\ [n] and X2[n] is identical to the linear convolution of x\ [n] and xj[n\. 

8.62. In some applications in coding theory, it is necessary to compute a 63-point circular con- 
volution of two 63-point sequences x[n] and h[n]. Suppose that the only computational 
devices available are multipliers, adders, and processors that compute jV-point DFTs, with 
N restricted to be a power of 2. 

(a) It is possible to compute the 63-point circular convolution of x[n] and h[n] using a num- 
ber of 64-point DFTs, inverse DFTs, and the overlap-add method. How many DFTs 
are needed? Hint: Consider each of the 63-point sequences as the sum of a 32-point 
sequence and 31 -point sequence. 

(b) Specify an algorithm that computes the 63-point circular convolution of x[n] and h[n] 
using two 128-point DFTs and one 128-point inverse DFT. 
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(c) We could also compute the 63-point circular convolution of x[n] and h[n] by computing 
their linear convolution in the time domain and then aliasing the results. In terms of 
multiplications, which of these three methods is most efficient? Which is least efficient? 
(Assume that one complex multiplication requires four real multiplications and that 
x[n] and h[n\ are real.) 

8.63. We want to filter a very long string of data with an FIR filter whose impulse response 
is 50 samples long. We wish to implement this filter with a DFT using the overlap-save 
technique. The procedure is as follows: 

1. The input sections must be overlapped by V samples, 

2. From the output of each section, we must extract M samples such that when these 
samples from each section are abutted, the resulting sequence is the desired filtered 
output. 

Assume that the input segments are 100 samples long and that the size of the DFT is 
128 (= 2 7 ) points. Assume further that the output sequence from the circular convolution 
is indexed from point to point 127. 

(a) Determine V. 

(b) Determine M. 

(c) Determine the index of the beginning and the end of the M points extracted; i.e., deter- 
mine which of the 128 points from the circular convolution are extracted to be abutted 
with the result from the previous section. 

8.64. A problem that often arises in practice is one in which a distorted signal y[n] is the output 
that results when a desired signal x[n] has been filtered by an LTI system. We wish to re- 
cover the original signal x[n] by processing y[n\. In theory, x[n] can be recovered from y[n] 
by passing y[n] through an inverse filter having a system function equal to the reciprocal 
of the system function of the distorting filter. 

Suppose that the distortion is caused by an FIR filter with impulse response 

h[n] =8[n]~ -8[n - « ], 

where no is a positive integer, i.e., the distortion of x[n] takes the form of an echo at delay n {) , 

(a) Determine the z-transform H(z) and the /V-point DFT H[k] of the impulse response 
h[n]. Assume that N = 4n$. 

(b) Let Hi(z) denote the system function of the inverse filter, and let hj[n] be the corre- 
sponding impulse response. Determine h,[n]. Is this an FIR or an IIR filter? What is 
the duration of /*,[«]? 

(c) Suppose that we use an FIR filter of length N in an attempt to implement the inverse 
filter, and let the /V-point DFT of the FIR filter be 

G[k] = \/H[k], fc = 0, 1,..., N-l. 

What is the impulse response g[n] of the FIR filter? 

(d) It might appear that the FIR filter with DFT G[k] = l/H[k] implements the inverse 
filter perfectly. After all, one might argue that the FIR distorting filter has an TV-point 
DFT H[k] and the FIR filter in cascade has an Appoint DFT G[k] = \/H[k], and since 
G[/c]H[/c] = 1 for all /c, we have implemented an all-pass, nondistorting filter. Briefly 
explain the fallacy in this argument. 

(e) Perform the convolution of g[n] with h[n], and thus determine how well the FIR filter 
with iV-point DFT G[k] = 1/ H[k] implements the inverse filter. 

8.65. A sequence x[n] of length N has a discrete Hartley transform (DHT) defined as 

X H [k) = ^2x[n]H N [nk], k = 0, 1, . . . , N - 1, (P8.65-1) 

n=0 



Chap. 8 Problems 625 

where 

H N [a] = C N [a] + S N [a], 

with 

C^[a] = co$(27ra/N), S/v[a] — sin(27ia/N). 

Originally proposed by RV.L. Hartley in 1942 for the continuous-time case, the Hartley 
transform has properties that make it useful and attractive in the discrete-time case as well 
(Bracewell, 1983, 1984). Specifically, from Eq. (P8.65-1), it is apparent that the DHT of a 
real sequence is also a real sequence. In addition, the DHT has a convolution property, and 
fast algorithms exist for its computation. 

In complete analogy with the DFT, the DHT has an implicit periodicity that must be 
acknowledged in its use. That is, if we consider x[n] to be a finite-length sequence such that 
x[n] = for n < and n > N — 1, then we can form a periodic sequence 



x[n] = ^2 x[n + rN] 



such that x[n] is simply one period of x[n]. The periodic sequence x[n] can be represented 
by a discrete Hartley series (DHS), which in turn can be interpreted as the DHT by focusing 
attention on only one period of the periodic sequence. 

(a) The DHS analysis equation is defined by 

N-\ 

X H [k] = ^x[n]H N [nk]. (P8.65-2) 

n=0 

Show that the DHS coefficients form a sequence that is also periodic with period N\ i.e., 

X H [k] = X H [k+N] for all it. 

(b) It can also be shown that the sequences H\'[nk] are orthogonal; i.e., 

Using this property and the DHS analysis formula of Eq. (P8.65-2), show that the DHS 
synthesis formula is 

1 ^ 
x[n] =jjYl X H [k\H N [nk]. (P8.65-3) 

Note that the DHT is simply one period of the DHS coefficients, and likewise, the DHT 
synthesis (inverse) equation is identical to the DHS synthesis equation (P8.65-3), except 
that we simply extract one period of x[n]; i.e., the DHT synthesis expression is 

1 N ~ l 
x[n] = — ^2 X H [k]H N [nkl n = 0, 1, . . . , N - 1. (P8.65-4) 

*=o 
With Eqs. (P8.65-1) and (P8.65-4) as definitions of the analysis and synthesis relations, 
respectively, for the DHT, we may now proceed to derive the useful properties of this 
representation of a finite-length discrete-time signal. 

(c) Verify that H^[a] = H^[a + N], and verify the following useful property of H^la]: 

H N [a + b] = H N [a]C N [b] + H N [-a]S N [b] 
= H N [b]C N [a] + H N [-b]S N [a]. 
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(d) Consider a circularly shifted sequence 

w (-?[«-«,,] = *(((« -««))*]. " = 0.1 N-\. 

1 J 10, otherwise. 

In other words, x\ [n] is the sequence that is obtained by extracting one period from the 
shifted periodic sequence x[n — n {} ]. Using the identity verified in Part (c), show that 
the DHS coefficients for the shifted periodic sequence are 

x[n - n n ] ^% X n [k]C N [n {) k] + *//[-*]$*[>!(,*]. (P8.65-6) 

From this, we conclude that the DHT of the finite-length circularly shifted sequence 
x[((n - n { ))) N ] is 

x[((n - n„)) N ] ?H X,i[k]C N [ ni) k] + X u l((-k)) N ]S N [n tt k]. (P8.65-7) 

(e) Suppose that x?,[n] is the Appoint circular convolution of two A/- point sequences x\ [n] 
and xi[n\\ i.e., 

X M"\ = x\\n] ®-*2[n] 



;V -' (P8.65-8) 

Xilmteldn-m))^ n = 0, 1. . . . , N - 1. 



= £ 



By applying the DHT to both sides of Eq. (P8.65-8) and using Eq. (P8.65-7), show that 

X„,[k] = ±X m [k](X„ 2 [k] + X n2 [((-k))N]) 

(P8.65-9) 
+ \X m [{{-k)) N }{X H2 [k] - X, n \({-k))»]) 

for k = 0, 1 jV — 1 . This is the desired convolution property. 

Note that a linear convolution can be computed using the DHT in the same way that 
the DFT can be used to compute a linear con volut ion. While computing Xf/?, [k] from X\\ \ [k] 
and AV/2[&] requires the same amount of computation as computing X^k] from X\ [k] and 
X 2 [k], the computation of the DHT requires only half the number of real multiplications 
required to compute the DFT. 

(f) Suppose that we wish to compute the DHT of an N-point sequence x[n] and we have 
available the means to compute the /V-point DFT. Describe a technique for obtaining 
X H [k] from X[k] for k = 0, 1 N - 1. 

(g) Suppose that we wish to compute the DFT of an jV-point sequence x[n] and we have 
available the means to compute the A/-point DHT. Describe a technique for obtaining 
X[k] from X H [k] for k = 0, 1 N- 1. 

8.66. Let x[n] be an Appoint sequence such that x[n] = for n < and for n > N — 1. Let x[n] 
be the 2/V-point sequence obtained by repeating x[n]: i.e., 

( x[n], 0</7<jV-1, 

x[n] = i x[n- N], N <n <2N-\. 
( 0, otherwise. 

Consider the implementation of a discrete-time filter shown in Figure P8.66b-1. This 
system has an impulse response h[n] that is 2/V points long; i.e., h[n] = for n < and for 
n>2N-\. 

(a) In Figure P8.66b-1, what is X[k], the 2/V-point DFT of 3t[n], in terms of X[k\ the 
N-pointDFTof*[>i]? 

(b) The system shown in Figure P8.66b-1 can be implemented using only /V-point DFTs as 
indicated in Figure P8.66-2 for appropriate choices for System /land System B. Specify 
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System A and System B so that y[n] in Figure P8,66b-1 and y[n] in Figure P8.66-2 are 
equal for < n < IN — 1. Note that h[n] and y[n] in Figure P8.66-2 are 2A/-point 
sequences and w[n] and g[n] are /V-point sequences. 
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Figure P8.66-1 
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Figure P8.66-2 

8.67. In this problem, you will examine the use of the DFT to implement the filtering necessary 
for the discrete-time interpolation, or upsampling, of a signal. Assume that the discrete-time 
signal x[n] was obtained by sampling a continuous-time signal x c {i) with a sampling period 
T. Moreover, the continuous-time signal is appropriately bandlimited; i.e., X c (j£l) = for 
\Q\ > 2tt/T. For this problem, we will assume that x[n) has length N; i.e., x[n] — for 
n < or n > N — 1, where N is even. It is not strictly possible to have a signal that is both 
perfectly bandlimited and of finite duration, but this is often assumed in practical systems 
processing finite-length signals which have very little energy outside the band \Q\ < 2tt/ T. 
We wish to implement a 1:4 interpolation, i.e., increase the sampling rate by a factor 
of 4. As seen in Figure 4.24, we can perform this sampling rate conversion using a sampling 
rate expander followed by an appropriate lowpass filter. In this chapter, we have seen that 
the lowpass filter could be implemented using the DFT if the filter is an FIR impulse re- 
sponse. For this problem, assume that this filter has an impulse response h[n] that is N + 1 
points long. Figure P8.67-1 depicts such a system, where H[k] is the 4/V-point DFT of the 
impulse response of the lowpass filter. Note that both v[n) and y[n] are 4 AZ-point sequences. 
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(a) Specify the DFT H[k] such that the system in Figure P8.67-1 implements the desired 
upsampling system. Think carefully about the phase of the values of H[k]. 

(b) It is also possible to upsample x[n] using the system in Figure P8.67-2. Specify System 
A in the middle box so that the 4jY-point signal y2[n] in this figure is the same as y[n] 
in Figure P8.67-2. Note that System A may consist of more than one operation. 

(c) Is there a reason that the implementation in Figure P8.67-2 might be preferable to Fig- 
ure P8.67-1? 




4N-point 
1DFT 



yiW\ 



Figure P8.67-2 



8.68. Derive Eq. (8.153) using Eqs. (8.164) and (8.165). 

8.69. Consider the following procedure 

(a) Form the sequence v[n] = *2[2rt] where X2[n] is given by Eq. (8.166). This yields 

v[n] = x[2n] n = 0, 1 N/2 - 1 

v[N-\ -n] = jt[2rt + l], « = 0, 1 N/2- 1. 



(b) Compute V[k], the TV-point DFT of v[n]. 

Demonstrate that the following is true: 

X c2 [k] = 2TZe{e'^ 2nk ^ N W[k]}. 

JV-l 

= 2 >^ v[rt]cos 



n=0 
/V-l 



7zk(4n + l) 



2N 



k = Q,l,. 
k = 0,l,. 



7V-1, 



N- 1, 



= 2 > jc[n]cos 



n=Q 



7ik(2n + 1) 

IN 



Jt = 0, 1 , A^- 1. 



Note that this algorithm uses /V-point rather than 27V-point DFTs as required in 
Eq. (8.167). In addition, since v[n] is a real sequence, we can exploit even and odd 
symmetries to do the computation of V[k] in one iY/4-point complex DFT. 

8.70. Derive Eq. (8.156) using Eqs. (8.174) and (8.175). 

8.71. (a) Use Parseval's theorem for the DFT to derive a relationship between ]P | A" el [&]| 2 and 

£ i*[»]i 2 - 

(b) Use Parseval's theorem for the DFT to derive a relationship between ]P lA^ 2 ^]! 2 and 

£l*Ml 2 . 
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9.0 INTRODUCTION 

The discrete Fourier transform (DFT) plays an important iole in the analysis, design, 
and implementation of discrete-time signal-processing algorithms and systems. The 
basic properties of the Fourier transform and discrete Fourier transform, discussed in 
Chapters 2 and 8, respectively, make it particularly convenient to analyze and design 
systems in the Fourier domain. Equally important is the fact that efficient algorithms 
exist for explicitly computing the DFT. As a result, the DFT is an important component 
in many practical applications of discrete-time systems. 

As discussed in Chapter 8, the DFT is identical to samples of the Fourier trans- 
form at equally spaced frequencies. Consequently, computation of the Appoint DFT 
corresponds to the computation of N samples of the Fourier transform at N equally 
spaced frequencies u> k = 2nk/N, i.e., at N points on the unit circle in the z-plane. In 
this chapter, we discuss several methods for computing values of the DFT. The major 
focus of the chapter is a particularly efficient class of algorithms for the digital computa- 
tion of the A-point DFT. Collectively, these efficient algorithms are called fast Fourier 
transform (FFT) algorithms, and we discuss them in Sections 9.3 and 9.4. To achieve the 
highest efficiency, the FFT algorithms must compute all N values of the DFT. When we 
require values of the DFT over only a portion of the frequency range < a> < 2jt, other 
algorithms may be more efficient and flexible, even though they are less efficient than 
the FFT algorithms for computation of all the values of the DFT. Examples of such 
algorithms are the Goertzel algorithm, discussed in Section 9.2, and the chirp transform 
algorithm, discussed in Section 9.6.2. 

There are many ways to measure the complexity and efficiency of an implemen- 
tation or algorithm, and a final assessment depends on both the available technology 

629 
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and the intended application. We will use the number of arithmetic multiplications and 
additions as a measure of computational complexity. This measure is simple to apply, 
and the number of multiplications and additions is directly related to the computa- 
tional speed when algorithms are implemented on general-purpose digital computers 
or special-purpose microprocessors. However, other measures are sometimes more ap- 
propriate. For example, in custom VLSI implementations, the area of the chip and 
power requirements are important considerations and may not be directly related to 
the number of arithmetic operations. 

In terms of multiplications and additions, the class of FFT algorithms can be or- 
ders of magnitude more efficient than competing algorithms. The efficiency of FFT 
algorithms is so high, in fact, that in many cases the most efficient procedure for imple- 
menting a convolution is to compute the transform of the sequences to be convolved, 
multiply their transforms, and then compute the inverse transform of the product of 
transforms. The details of this technique were discussed in Section 8.7. In seeming con- 
tradiction to this, there is a set of algorithms (mentioned briefly in Section 9.6) for 
evaluation of the DFT (or a more general set of samples of the Fourier transform) that 
derive their efficiency from a reformulation of the Fourier transform in terms of a con- 
volution and thereby implement the Fourier transform computation by using efficient 
procedures for evaluating the associated convolution. This suggests the possibility of 
implementing a convolution by multiplication of DFTs, where the DFTs have been 
implemented by first expressing them as convolutions and then taking advantage of 
efficient procedures for implementing the associated convolutions. While this seems on 
the surface to be a basic contradiction, we will see in Section 9.6 that in certain cases it 
is an entirely reasonable approach and is not at all a contradiction. 



9.1 EFFICIENT COMPUTATION OF THE DISCRETE 
FOURIER TRANSFORM 

As defined in Chapter 8, the DFT of a finite-length sequence of length N is 

*[*] = £ JC M W *'' * = 0,l,...,iV-l, (9.1) 

where W# = e~^ 27T/N \ The inverse discrete Fourier transform is given by 

1 "- 1 
*M = Ji J2 X[ k ] W N kn > n = 0, 1, . . . , iV - 1. (9.2) 

fc=0 

In Eqs. (9.1) and (9.2), both x[n] and X[k] may be complex. Since the expressions on 
the right-hand sides of those equations differ only in the sign of the exponent of Wn and 
in the scale factor 1/N, a discussion of computational procedures for Eq. (9.1) applies 
with straightforward modifications to Eq. (9.2). (See Problem 9.1.) 

To create a frame of reference for our discussion of computation of the DFT, let 
us first consider direct evaluation of the DFT expression in Eq. (9.1). Since x[n] may 
be complex, N complex multiplications and (TV — 1) complex additions are required to 
compute each value of the DFT if we use Eq. (9.1) directly as a formula for computa- 
tion. To compute all N values therefore requires a total of N 2 complex multiplications 
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and N(N — 1) complex additions. Expressing Eq. (9.1) in terms of operations on real 
numbers, we obtain 

N-l 

X[k] = Y, [(ne{x[n\}Ue{W^} - Jm[x[n]}Jm{W$p\) 

+ j(Ke{x[n]}Jm{W* n } + Jm{x[n]}ne{W* n })} , (9.3) 

* = o,i,...,n-i, 

which shows that each complex multiplication requires four real multiplications and 
two real additions, and each complex addition requires two real additions. Therefore, 
for each value of k, the direct computation of X[k] requires 4N real multiplications and 
(4N — 2) real additions. 1 Since X[k] must be computed for N different values of k, the 
direct computation of the discrete Fourier transform of a sequence x[n] requires 47V 2 
real multiplications and N(4N — 2) real additions. Besides the multiplications and addi- 
tions called for by Eq. (9.3), the digital computation of the DFT on a general-purpose 
digital computer or with special-purpose hardware also requires provision for storing 
and accessing the N complex input sequence values x[n] and values of the complex 
coefficients W^ n . Since the amount of computation, and thus the computation time, is 
approximately proportional to N 2 , it is evident that the number of arithmetic opera- 
tions required to compute the DFT by the direct method becomes very large for large 
values of N. For this reason, we are interested in computational procedures that reduce 
the number of multiplications and additions. 

Most approaches to improving the efficiency of the computation of the DFT ex- 
ploit the symmetry and periodicity properties of Wfc n ; specifically, 

1. W* [N - n] = W„ kn = (Wk n )* (complex conjugate symmetry); 

2. W* n = W$ n+N) = W ( N k+N)n (periodicity in n and k). 

As an illustration, using the first property, i.e., the symmetry of the implicit cosine and 
sine functions, we can group terms in the summation in Eq. (9.3) for n and (N — n). For 
example, 

ne{x[n]}Ke[W* n } + 1Ze{x[N - n]}Ue{ W^ [N ~ n] } 

= (ne{x[n]} + 1le{x[N - n]})1Ze{ W*"} 

and 

-Jm{x[n]}Jm{Wfc n } - Jm{x[N - n]}Jm{W^~ n] } 

= -(Jm{x[n]}- Jm{x[N-n]})JmlW* n }. 

Similar groupings can be used for the other terms in Eq. (9.3). In this way, the number of 
multiplications can be reduced by approximately a factor of 2. We can also take advan- 
tage of the fact that for certain values of the product kn, the sine and cosine functions 

1 Throughout the discussion, the figure for the number of computations is only approximate. Multipli- 
cation by Wft, for example, does not require a multiplication. Nevertheless, the estimate of computational 
complexity obtained by including such multiplications is sufficiently accurate to permit comparisons between 
different classes of algorithms. 
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take on the value 1 or 0, thereby eliminating the need for multiplications. However, 
reductions of this type still leave us with an amount of computation that is proportional 
to N 2 . Fortunately, the second property, the periodicity of the complex sequence Wj", 
can be exploited in achieving significantly greater reductions of the computation. 

Computational algorithms that exploit both the symmetry and the periodicity of 
the sequence Wj^ n were known long before the era of high-speed digital computation. 
At that time, any scheme that reduced manual computation by even a factor of 2 was 
welcomed. Heideman et al. (1984) have traced the origins of the FFT back to Gauss, 
as early as 1805. Runge (1905) and later Danielson and Lanczos (1942) described al- 
gorithms for which computation was roughly proportional to Nlog N rather than N 2 . 
However, the distinction was not of great importance for the small values of N that 
were feasible for hand computation. The possibility of greatly reduced computation 
was generally overlooked until about 1965, when Cooley and Tukey (1965) published 
an algorithm for the computation of the discrete Fourier transform that is applicable 
when N is a composite number, i.e., the product of two or more integers. The publi- 
cation of their paper touched off a flurry of activity in the application of the discrete 
Fourier transform to signal processing and resulted in the discovery of a number of 
highly efficient computational algorithms. Collectively, the entire set of such algorithms 
has come to be known as the fast Fourier transform, or the FFT. 2 

FFT algorithms are based on the fundamental principle of decomposing the com- 
putation of the discrete Fourier transform of a sequence of length TV into successively 
smaller discrete Fourier transforms. The manner in which this principle is implemented 
leads to a variety of different algorithms, all with comparable improvements in computa- 
tional speed. In this chapter, we are concerned with two basic classes of FFT algorithms. 
The first, called decimation in time, derives its name from the fact that in the process of 
arranging the computation into smaller transformations, the sequence x[n] (generally 
thought of as a time sequence) is decomposed into successively smaller subsequences. 
In the second general class of algorithms, the sequence of discrete Fourier transform co- 
efficients X[k] is decomposed into smaller subsequences — hence its name, decimation 
in frequency. 

In the sections that follow, we consider a number of algorithms for computing the 
discrete Fourier transform. The algorithms vary in efficiency, but all of them require 
fewer multiplications and additions than does direct evaluation of Eq. (9.3). We begin 
in the next section with a discussion of Goertzel's algorithm (Goertzel, 1958), which 
requires computation proportional to TV 2 , but with a smaller constant of proportionality 
than that of the direct method. One of the principal advantages of Goertzel's algorithm 
is that it is not restricted to computation of the DFT, but is in fact equally valid for the 
computation of any desired set of samples of the Fourier transform of a sequence. 

In Sections 9.3 and 9.4 we present a detailed discussion of FFT algorithms for which 
computation is proportional to TV log N. This class of algorithms is considerably more 
efficient in terms of arithmetic operations than the Goertzel algorithm, but is specifically 
oriented toward computation of all the values of the DFT. We do not attempt to be 
exhaustive in our coverage of that class of algorithms, but we illustrate the general 
principles common to all algorithms of this type by considering in detail only a few of 
the more commonly used schemes. 

2 See Cooley et al. (1967) for a historical summary of results related to the FFT. 
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In Section 9.5, we consider some of the practical issues that arise in implementing 
the FFT. In Section 9.6, we discuss algorithms that rely on formulating the computation 
of the DFT in terms of a convolution. In Section 9.7, we consider effects of arithmetic 
roundoff. 



9.2 THE GOERTZEL ALGORITHM 

The Goertzel algorithm (Goertzel, 1958) is an example of how the periodicity of the 
sequence Wfc" can be used to reduce computation. To derive the algorithm, we begin 
by noting that 

W„ kN = e j(2n/N)Nk = e j2nk = 1. (9.4) 

This is, of course, a direct result of the periodicity of W^ kn . Because of Eq. (9.4), we 
may multiply the right side of Eq. (9.1) by W^ kN without affecting the equation. Thus, 

X[k] = W^ kN £ x[rW k N r = £ *Mntf <N-r) . (9-5) 

r=0 r=0 

To suggest the final result, let us define the sequence 

oo 

y k [n] = Y. x[r]W^"- r) u[n - r]. (9.6) 

r=— oo 

From Eqs. (9.5) and (9.6) and the fact that x[n] = for n < and n > N, it follows that 

X[k] = y k [n] (9.7) 

Equation (9.6) can be interpreted as a discrete convolution of the finite-duration se- 
quence x[n],0 < n < N — 1, with the sequence W^ kn u[n]. Consequently, yk[n] can be 
viewed as the response of a system with impulse response W^ fen M[n] to a finite-length 
input x[n]. In particular, X[k] is the value of the output when n = N. 

A system with impulse response W^ kn u[n] is depicted in Figure 9.1, where initial 
rest conditions are assumed. Since the general input x[n] and the coefficient W^ k are 
both complex, the computation of each new value of yk[n] using the system of Fig- 
ure 9.1 requires 4 real multiplications and 4 real additions. All the intervening values 
yic[l], >fc[2], . . . , >k[Af — 1] must be computed in order to compute yk[N] = X[k], so 
the use of the system in Figure 9.1 as a computational algorithm requires 4N real mul- 
tiplications and 4 ./V real additions to compute X[k] for a particular value of k. Thus, 
this procedure is slightly less efficient than the direct method. However, it avoids the 
computation or storage of the coefficients Wfc", since these quantities are implicitly 
computed by the recursion implied by Figure 9.1. 




Figure 9.1 Flow graph of first-order 
complex recursive computation of X [k]. 
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It is possible to retain this simplification while reducing the number of multipli- 
cations by a factor of 2. To see how this may be done, note that the system function of 
the system of Figure 9.1 is 

Hk{z) ' T^W^- (9 - 8) 

Multiplying both the numerator and the denominator of Hi\z\ by the factor (1 — W^z -1 ), 
we obtain 



*,-i 



H k (z) = 



1 - Wfc 



(l-H£V)(l-WjSz-i) 

1 - wfc-' 

l-Zcos^jrifc/AOz-'+z- 2 



(9.9) 



The signal flow graph of Figure 9.2 corresponds to the system of Eq. (9.9). 

If the input is complex, only two real multiplications per sample are required to 
implement the poles of this system, since the coefficients are real and the factor —1 need 
not be counted as a multiplication. As in the case of the first-order system, for a complex 
input, four real additions per sample are required to implement the poles (if the input 
is complex). Since we only need to bring the system to a state from which yk[N] can be 
computed, the complex multiplication by — W^ required to implement the zero of the 
system function need not be performed at every iteration of the difference equation, but 
only after the Mh iteration. Thus, the total computation is IN real multiplications and 
4N real additions for the poles, plus 4 real multiplications and 4 real additions for the 
zero. The total computation is therefore 2(N + 2) real multiplications and 4(N + 1) real 
additions, about half the number of real multiplications required with the direct method. 
In this more efficient scheme, we still have the advantage that cos(27tk/N) and Wfa are 
the only coefficients that must be computed and stored. The coefficients Wfc n are again 
computed implicitly in the iteration of the recursion formula implied by Figure 9.2. 

As an additional advantage of the use of this network, let us consider the com- 
putation of the z- transform of x[n] at conjugate locations on the unit circle, that is, the 
computation of X[k] and X[N — k]. It is straightforward to verify that the network in 
the form of Figure 9.2 required to compute X[N — k] has exactly the same poles as that 
in Figure 9.2, but the coefficient for the zero is the complex conjugate of that in Figure 
9.2. (See Problem 9.21.) Since the zero is implemented only on the final iteration, the 2N 
multiplications and AN additions required for the poles can be used for the computation 
of two DFT values. Thus, for the computation of all N values of the discrete Fourier 




Figure 9.2 Flow graph of second- 
order recursive computation of X[k] 
(Goertzel algorithm). 
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transform using the Goertzel algorithm, the number of real multiplications required 
is approximately N 2 and the number of real additions is approximately 2N 2 . While 
this is more efficient than the direct computation of the discrete Fourier transform, the 
amount of computation is still proportional lo N 2 . 

In either the direct method or the Goertzel method we do not need to evaluate 
X[k] at all N values of k. Indeed, we can evaluate X[k] for any M values of k, with 
each DFT value being computed by a recursive system of the form of Figure 9.2 with 
appropriate coefficients. In this case, the total computation is proportional to NM. The 
Goertzel method and the direct method are attractive when M is small; however, as 
indicated previously, algorithms are available for which the computation is proportional 
to A r log 2 N when N is a power of 2. Therefore, when M is less than log 2 N, either the 
Goertzel algorithm or the direct method may in fact be the most efficient method, 
but when all N values of X[k] are required, the decimation-in-time algorithms, to be 
considered next, are roughly (A^/log 2 N) times more efficient than either the direct 
method or the Goertzel method. 



9.3 DECIMATION-IN-TIME FFT ALGORITHMS 

In computing the DFT, dramatic efficiency results from decomposing the computation 
into successively smaller DFT computations. In this process, we exploit both the sym- 
metry and the periodicity of the complex exponential Wfc n = e -j(^/N)kn^ Algorithms in 
which the decomposition is based on decomposing the sequence x[n] into successively 
smaller subsequences are called decimation-in-time algorithms. 

The principle of the decimation-in-time algorithm is most conveniently illustrated 
by considering the special case of N an integer power of 2, i.e., N = 2 V . Since N is an 
even integer, we can consider computing X[k] by separating x[n] into two ( N/2)-point 3 
sequences consisting of the even-numbered points in x[n] and the odd-numbered points 
in x[ri\. With X[k] given by 

N-l 

X[k] = J2 x W W N k > * = 0, 1, . . . , JV- 1, (9-10) 

and separating x[n] into its even- and odd-numbered points, we obtain 

X[k]= £ x[n\W n N k + Y, 'W^JJ*. ( W1 ) 

n even n odd 

or, with the substitution of variables n = 2r for n even and n = 2r + 1 for n odd, 

{N/2)-l (A//2)-1 

X[k]= J2 *[2r]W 2 N rk + J2 *Pr + l]Wji, 2r+1 >* 



r=0 r=0 



{N/2)-] W2)-l 

= Yl 42r](W 2 Y k +W k N J2 x[2r + l](W 2 Y k . 

r=0 r=0 



(9.12) 



3 When discussing FFT algorithms, we use the words sample and point interchangeably to mean se- 
quence value. Also, we refer to a sequence of length N as an Appoint sequence, and the DFT of a sequence 
of length N will be called an N-point DFT. 
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But W N = W)v/2, since 



W 2 _ e -2j{2n/N) _ e -j2n/(N/2) = yy 



N 



N/2- 



(9.13) 



Consequently, Eq. (9.12) can be rewritten as 



(N/2)-l (N/2)-l 

X[k]= Y, xWWn/2 + K E 42r + 1]W$ 2 

r=0 r=0 

= G[k] + WfrH[k], k = 0, 1, . . . , N - 1. 



(9.14) 



Each of the sums in Eq. (9.14) is recognized as an (A r /2)-point DFT, the first sum being 
the (Ay2)-point DFT of the even-numbered points of the original sequence and the 
second being the ( A^/2)-point DFT of the odd-numbered points of the original sequence. 
Although the index k ranges over N values, /c = 0, 1, . . . , TV— 1, each of the sums must be 
computed only for k between and (N/2) — 1, since G[k] and H[k] are each periodic in 
k with period N/2. After the two DFTs are computed, they are combined according to 
Eq. (9.14) to yield the Appoint DFT X[k]. Figure 9.3 depicts this computation for N = 8. 
In this figure, we have used the signal flow graph conventions that were introduced in 
Chapter 6 for representing difference equations. That is, branches entering a node are 
summed to produce the node variable. When no coefficient is indicated, the branch 
transmittance is assumed to be unity. For other branches, the transmittance of a branch 
is an integer power of W N . 

In Figure 9.3, two 4-point DFTs are computed, with G[k] designating the 4-point 
DFT of the even-numbered points and H[k] designating the 4-point DFT of the odd- 
numbered points. X[0] is then obtained by multiplying H[0] by W% and adding the 
product to G[0]. X[l] is obtained by multiplying H[l] by W^ and adding that result 
to G[l]. Equation (9.14) states that, to compute X[4], we should multiply H[4] by W^ 
and add the result of G[4]. However, since G[k] and H[k] are both periodic in k with 



jc[0]o 



x[2] o 



*[4]o 



x[6]o 



*[l]o 



jc[3]o 



*[5]o 



*[7]o 




Figure 9.3 Flow graph of the 
decimation-in-time decomposition of an 
N -point DFT computation into two 
(/V/2)-point DFT computations 
(N = 8). 
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period 4, H[4] = H[0] and G[4] = G[0]. Thus, X[4] is obtained by multiplying H[0] 
by W^ and adding the result to G[0]. As shown in Figure 9.3, the values X[5], X[6], 
and X [7] are obtained similarly. 

With the computation restructured according to Eq. (9.14), we can compare the 
number of multiplications and additions required with those required for a direct com- 
putation of the DFT. Previously we saw that, for direct computation without exploiting 
symmetry, N 2 complex multiplications and additions were required. 4 By comparison, 
Eq. (9.14) requires the computation of two (N/2)-point DFTs, which in turn requires 
2(N/2) 2 complex multiplications and approximately 2(N/2) 2 complex additions if we 
do the (Ay2)-point DFTs by the direct method. Then the two (A^/2)-point DFTs must 
be combined, requiring N complex multiplications, corresponding to multiplying the 
second sum by W£, and N complex additions, corresponding to adding the product 
obtained to the first sum. Consequently, the computation of Eq. (9.14) for all values 
of k requires at most N + 2(N/2) 2 oriV+ N 2 /2 complex multiplications and complex 
additions. It is easy to verify that for N > 2, the total N + N 2 /2 will be less than N 2 . 

Equation (9.14) corresponds to breaking the original Appoint computation into 
two (A r /2)-point DFT computations. If N/2 is even, as it is when N is equal to a power 
of 2, then we can consider computing each of the (N/2)-point DFTs in Eq. (9.14) by 
breaking each of the sums in that equation into two (N/4)-point DFTs, which would 
then be combined to yield the (N/2)-point DFTs. Thus, G[k] in Eq. (9.14) would be 
represented as 

(JV/2)-l W4)-l (W/4)-l 

G[*l= £ gVW' N k ,2= £ S[2e]W^+ £ g[2l + l]W$ +,) *, (9.15) 

r=0 1=0 i=0 

or 

(JV/4)-l (W/4)-l 

G[k]= £ gPQWfa + Wkp £ gW + l]W[, k /4 . (9.16) 

Similarly, H[k] would be represented as 

(JV/4)-l (Af/4)-l 

H[k]= £ h[2l]W» A + Wb fl £ h[2i + l]Wf,%. (9.17) 

£=0 e=o 

Consequently, the (A^/2)-point DFT G[k] can be obtained by combining the (A r /4)-point 
DFTs of the sequences g[2i] and g[2l + 1]. Similarly, the (JV/2)-point DFT H[k] can 
be obtained by combining the (N/4)-point DFTs of the sequences h\2t\ and h\2l + 1]. 
Thus, if the 4-point DFTs in Figure 9.3 are computed according to Eqs. (9.16) and 
(9.17), then that computation would be carried out as indicated in Figure 9.4. Inserting 
the computation of Figure 9.4 into the flow graph of Figure 9.3, we obtain the complete 
flow graph of Figure 9.5, where we have expressed the coefficients in terms of powers 
of W N rather than powers of W N/2 , using the fact that W N/2 = W^. 

For the 8-point DFT that we have been using as an illustration, the computation 
has been reduced to a computation of 2-point DFTs. For example, the 2-point DFT of 
the sequence consisting of jc[0] and x[4] is depicted in Figure 9.6. With the computation 

4 For simplicity, we shall assume that N is large, so that (N - 1) can be approximated by N. 
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Figure 9.4 Flow graph of the 
decimation-in-time decomposition of an 
(A//2)-point DFT computation into two 
(A//4)-point DFT computations 
(0 = 8). 



Figure 9.5 Result of substituting the 
structure of Figure 9.4 into Figure 9.3. 
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Figure 9.6 

DFT. 



Flow graph of a 2-point 



of Figure 9.6 inserted in the flow graph of Figure 9.5, we obtain the complete flow graph 
for computation of the 8-point DFT, as shown in Figure 9.7. 

For the more general case, but with TV still a power of 2, we would proceed by 
decomposing the (TV/4)-point transforms in Eqs. (9.16) and (9.17) into (TV/8)-point 
transforms and continue until we were left with only 2-point transforms. This requires 
v = log 2 N stages of computation. Previously, we found that in the original decomposi- 
tion of an TV-point transform into two (N/2) -point transforms, the number of complex 
multiplications and additions required was TV + 2(TV/2) 2 . When the (N/2) -point trans- 
forms are decomposed into (TV/4)-point transforms, the factor of (N/2) 2 is replaced by 
N/2 + 2(TV/4) 2 , so the overall computation then requires N + TV + 4(TV/4) 2 complex 
multiplications and additions. If TV = 2 V , this can be done at most v = log 2 TV times, 
so that after carrying out this decomposition as many times as possible, the number of 
complex multiplications and additions is equal to Nv = TVlog 2 TV. 
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Figure 9.7 Flow graph of complete 
decimation-in-time decomposition ot an 
8-point DFT computation. 



(m - l)st 
stage 




w (r + NI2) 



Figure 9.8 Flow graph of basic 
butterfly computation in Figure 9.7. 



The flow graph of Figure 9.7 displays the operations explicitly. By counting 
branches with transmittances of the form W r N , we note that each stage has N complex 
multiplications and N complex additions. Since there are log 2 N stages, we have a total 
of A r log 2 N complex multiplications and additions. This is the substantial computational 
savings that we have previously indicated was possible. For example, if TV = 2 10 = 1024, 
then TV 2 = 2 20 = 1,048,576, and 7Vlog 2 N = 10,240, a reduction of more than two 
orders of magnitude! 

The computation in the flow graph of Figure 9.7 can be reduced further by exploit- 
ing the symmetry and periodicity of the coefficients W r N . We first note that, in proceeding 
from one stage to the next in Figure 9.7, the basic computation is in the form of Fig- 
ure 9.8, i.e., it involves obtaining a pair of values in one stage from a pair of values in the 
preceding stage, where the coefficients are always powers of Wn and the exponents are 
separated by N/2. Because of the shape of the flow graph, this elementary computation 
is called a butterfly. Since 



\y N / 2 = e -J(2*/X)N/2 = e -jn „ _^ 



(9.18) 



the factor W F k, + / can be written as 



N 



w r+N/2 _ W N/2 W r — -W r 

w n — ^N ** n — w n- 



(9.19) 
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With this observation, the butterfly computation of Figure 9.8 can be simplified to the 
form shown in Figure 9.9, which requires only one complex multiplication instead of 
two. Using the basic flow graph of Figure 9.9 as a replacement for butterflies of the form 
of Figure 9.8, we obtain from Figure 9.7 the flow graph of Figure 9.10. In particular, the 
number of complex multiplications has been reduced by a factor of 2 over the number 
in Figure 9.7. 



(m - l)st 
stage 




Figure 9.9 Flow graph of simplified 
butterfly computation requiring only one 
complex multiplication. 



9.3.1 In-Place Computations 

The flow graph of Figure 9.10 describes an algorithm for the computation of the discrete 
Fourier transform. The essential features of the flow graph are the branches connecting 
the nodes and the transmittance of each of these branches. No matter how the nodes in 
the flow graph are rearranged, it will always represent the same computation, provided 
that the connections between the nodes and the transmittances of the connections 
are maintained. The particular form for the flow graph in Figure 9.10 arose out of 
deriving the algorithm by separating the original sequence into the even-numbered and 
odd-numbered points and then continuing to create smaller and smaller subsequences 
in the same way. An interesting by-product of this derivation is that this flow graph, 
in addition to describing an efficient procedure for computing the discrete Fourier 
transform, also suggests a useful way of storing the original data and storing the results 
of the computation in intermediate arrays. 

To see this, it is useful to note that according to Figure 9.10, each stage of the 
computation takes a set of N complex numbers and transforms them into another set of 




w N 



Figure 9.10 Flow graph of 8-point DFT 
using the butterfly computation of 
Figure 9.9. 
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N complex numbers through basic butterfly computations of the form of Figure 9.9. This 
process is repeated v = log 2 N times, resulting in the computation of the desired discrete 
Fourier transform. When implementing the computations depicted in Figure 9.10, we 
can imagine the use of two arrays of (complex) storage registers, one for the array 
being computed and one for the data being used in the computation. For example, in 
computing the first array in Figure 9.10, one set of storage registers would contain the 
input data and the second set would contain the computed results for the first stage. 
While the validity of Figure 9.10 is not tied to the order in which the input data are stored, 
we can order the set of complex numbers in the same order that they appear in the figure 
(from top to bottom). We denote the sequence of complex numbers resulting from the 
rath stage of computation as A" m [£], where I = 0, 1, . . . , N — 1, and ra = 1, 2, . . . , p. 
Furthermore, for convenience, we define the set of input samples as A^]. We can 
think of A" m _i[£] as the input array and A" m [£] as the output array for the rath stage of 
the computations. Thus, for the case of N = 8, as in Figure 9.10, 

* [0] = *[0 

*o[l] = *[4 
X [2] = x[2 
X [3] = x[6 
X [4] = x[l 
X [5] = x[S 
X [6] = *[3 
X [7] = x[7 

Using this notation, we can label the input and output of the butterfly computation in 
Figure 9.9 as indicated in Figure 9.11, with the associated equations 



(9.20) 



X m [p] = X m - 1 [p] + W r N X m - 1 [q], 
X m [q] = X m . x [p] - W T N X m . x [ql 



(9.21a) 
(9.21b) 



In Eqs. (9.21), /?, q, and r vary from stage to stage in a manner that is readily 
inferred from Figure 9.10 and from Eqs. (9.11), (9.14), (9.16), etc. It is clear from Fig- 
ures 9.10 and 9.11 that only the complex numbers in locations p and q of the (ra — l)st 
array are required to compute the elements p and q of the rath array. Thus, only one 
complex array of N storage registers is physically necessary to implement the complete 
computation if ^[p] and X m [q] are stored in the same storage registers as X m -i[p] and 
X m -\[q], respectively. This kind of computation is commonly referred to as an in-place 




Figure 9.11 Flow graph of Eqs. (9.21 ). 
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computation. The fact that the flow graph of Figure 9.10 (or Figure 9.7) represents an 
in-place computation is tied to the fact that we have associated nodes in the flow graph 
that are on the same horizontal line with the same storage location and the fact that the 
computation between two arrays consists of a butterfly computation in which the input 
nodes and the output nodes are horizontally adjacent. 

In order that the computation may be done in place as just discussed, the input 
sequence must be stored (or at least accessed) in a nonsequential order, as shown in 
the flow graph of Figure 9.10. In fact, the order in which the input data are stored and 
accessed is referred to as bit-reversed order. To see what is meant by this terminology, 
we note that for the 8-point flow graph that we have been discussing, three binary digits 
are required to index through the data. Writing the indices in Eqs. (9.20) in binary form, 
we obtain the following set of equations: 

Z [000] = jc[000], 

Z [001] = jc[100], 

*o[010] = jc[010], 

^o[011]=jc[110], 

*o[100] = Jt[001], 

Z [101] =jc[101], 

Ab[110] =jc[011], 

Ab[lll] =jc[111]. 

If (/t2, /ii, no) is the binary representation of the index of the sequence x[n], then the 
sequence value jt[/i 2 ,/ii,/io] is stored in the array position Xo[no, n\, n^ That is, in 
determining the position of x[n 2 , n\, no] in the input array, we must reverse the order 
of the bits of the index n. 

Let us first consider the process depicted in Figure 9.12 for sorting a data sequence 
in normal order by successive examination of the bits representing the data index. If 
the most significant bit of the data index is zero, x[n] belongs in the top half of the 
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Figure 9.12 Tree diagram depicting 
normal-order sorting. 
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sorted array; otherwise it belongs in the bottom half. Next, the top half and bottom half 
subsequences can be sorted by examining the second most significant bit, and so on. 

To see why bit-reversed order is necessary for in-place computation, recall the 
process that resulted in Figure 9.7 and Figure 9.10. The sequence x[n] was first divided 
into the even-numbered samples, with the even-numbered samples occurring in the top 
half of Figure 9.3 and the odd-numbered samples occurring in the bottom half. Such 
a separation of the data can be carried out by examining the least significant bit [n ] 
in the index n. If the least significant bit is 0, the sequence value corresponds to an 
even-numbered sample and therefore will appear in the top half of the array A!o[£], 
and if the least significant bit is 1, the sequence value corresponds to an odd-numbered 
sample and consequently will appear in the bottom half of the array. Next, the even- 
and odd-indexed subsequences are sorted into their even- and odd-indexed parts, and 
this can be done by examining the second least significant bit in the index. Considering 
first the even-indexed subsequence, if the second least significant bit is 0, the sequence 
value is an even-numbered term in the subsequence, and if the second least significant 
bit is 1, then the sequence value has an odd-numbered index in this subsequence. The 
same process is carried out for the subsequence formed from the original odd-indexed 
sequence values. This process is repeated until N subsequences of length 1 are obtained. 
This sorting into even- and odd-indexed subsequences is depicted by the tree diagram 
of Figure 9.13. 

The tree diagrams of Figures 9.12 and 9.13 are identical, except that for normal 
sorting, we examine the bits representing the index from left to right, whereas for the 
sorting leading naturally to Figure 9.7 or 9.10, we examine the bits in reverse order, right 
to left, resulting in bit-reversed sorting. Thus, the necessity for bit-reversed ordering of 
the sequence x [n] results from the manner in which the DFT computation is decomposed 
into successively smaller DFT computations in arriving at Figures 9.7 and 9.10. 

9.3.2 Alternative Forms 

Although it is reasonable to store the results of each stage of the computation in the 
order in which the nodes appear in Figure 9.10, it is certainly not necessary to do 
so. No matter how the nodes of Figure 9.10 are rearranged, the result will always be 
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Figure 9.13 Tree diagram depicting 
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a valid computation of the discrete Fourier transform of x[n], as long as the branch 
transmittances are unchanged. Only the order in which data are accessed and stored 
will change. If we associate the nodes with indexing of an array of complex storage 
locations, it is clear from our previous discussion that a flow graph corresponding to an 
in-place computation results only if the rearrangement of nodes is such that the input and 
output nodes for each butterfly computation are horizontally adjacent. Otherwise two 
complex storage arrays will be required. Figure 9.10, is, of course, such an arrangement. 
Another is depicted in Figure 9.14. In this case, the input sequence is in normal order and 
the sequence of DFT values is in bit-reversed order. Figure 9.14 can be obtained from 
Figure 9.10 as follows: All the nodes that are horizontally adjacent to x[4] in Figure 9.10 
are interchanged with all the nodes horizontally adjacent to x[l]. Similarly, all the nodes 
that are horizontally adjacent to x[6] in Figure 9.10 are interchanged with those that are 
horizontally adjacent to jc[3]. The nodes horizontally adjacent to *[0], jc[2], jc[5], and 
x[7] are not disturbed. The resulting flow graph in Figure 9.14 corresponds to the form 
of the decimation-in-time algorithm originally given by Cooley and Tukey (1965). 

The only difference between Figures 9.10 and 9.14 is in the ordering of the nodes. 
The branch transmittances (powers of W N ) remain the same. There are, of course, a 
large variety of possible orderings. However, most do not make much sense from a 
computational viewpoint. As one example, suppose that the nodes are ordered such 
that the input and output both appear in normal order. A flow graph of this type is 
shown in Figure 9.15. In this case, however, the computation cannot be carried out in 
place because the butterfly structure does not continue past the first stage. Thus, two 
complex arrays of length N would be required to perform the computation depicted in 
Figure 9.15. 

In realizing the computations depicted by Figures 9.10, 9.14, and 9.15, it is clearly 
necessary to access elements of intermediate arrays in nonsequential order. Thus, for 
greater computational speed, the complex numbers must be stored in random-access 
memory. For example, in the computation of the first array in Figure 9.10 from the 
input array, the inputs to each butterfly computation are adjacent node variables and 
are thought of as being stored in adjacent storage locations. In the computation of 
the second intermediate array from the first, the inputs to a butterfly are separated by 
two storage locations; and in the computation of the third array from the second, the 
inputs to a butterfly computation are separated by four storage locations. If N > 8, the 
separation between butterfly inputs is 8 for the fourth stage, 16 for the fifth stage, and 
so on. The separation in the last (i>th) stage is N/2. 

In Figure 9.14 the situation is similar in that, to compute the first array from the in- 
put data we use data separated by 4, to compute the second array from the first array we 
use input data separated by 2, and then finally, to compute the last array we use adjacent 
data. Although it is straightforward to imagine simple algorithms for modifying index 
registers to access the data in the flow graph of either Figure 9.10 or Figure 9.14, the data 
are not accessed sequentially, so random-access memory would be very desirable. In the 
flow graph of Figure 9.15, the data are accessed nonsequentially, the computation is not 
in place, and a scheme for indexing the data is considerably more complicated than in ei- 
ther of the two previous cases. Consequently, this structure has no apparent advantages. 

Some forms have advantages even if in-place computation is not possible. A re- 
arrangement of the flow graph in Figure 9.10 that is particularly useful when random- 
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Figure 9.14 Rearrangement of 
Figure 9.10 with input in normal order 
and output in bit-reversed order. 



Figure 9.15 Rearrangement of 
Figure 9.10 with both input and output in 
normal order. 



Figure 9.16 Rearrangement of 
Figure 9.10 having the same geometry 
for each stage, thereby permitting 
sequential data accessing and storage. 
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access memory is not available is shown in Figure 9.16. This flow graph represents 
the decimation-in-time algorithm originally given by Singleton (1969). (See DSP Com- 
mittee, 1979, for a program using serial memory.) Note first that in this flow graph the 
input is in bit-reversed order and the output is in normal order. The important feature 
of the flow graph is that the geometry is identical for each stage; only the branch trans- 
mittances change from stage to stage. This makes it possible to access data sequentially. 
Suppose, for example that we have four separate disk files, and suppose that the first 
half of the input sequence (in bit-reversed order) is stored in one file and the second 
half is stored in a second file. Then the sequence can be accessed sequentially in files 
1 and 2 and the results written sequentially on files 3 and 4, with the first half of the 
new array being written to file 3 and the second half to file 4. Then at the next stage of 
computation, files 3 and 4 are the input, and the output is written to files 1 and 2. This 
is repeated for each of the v stages. Such an algorithm could be useful in computing the 
DFT of extremely long sequences. 



9.4 DECIMATION-IN-FREQUEIMCY FFT ALGORITHMS 

The decimation-in-time FFT algorithms are all based on structuring the DFT compu- 
tation by forming smaller and smaller subsequences of the input sequence x[n]. Alter- 
natively, we can consider dividing the output sequence X[k] into smaller and smaller 
subsequences in the same manner. FFT algorithms based on this procedure are com- 
monly called decimation-in-frequency algorithms. 

To develop these FFT algorithms, let us again restrict the discussion to N a power 
of 2 and consider computing separately the even-numbered frequency samples and the 
odd-numbered frequency samples. Since 

N-l 

X[k] = Y, x[n]W% k , k = 0, 1, . . . , N - 1, (9.23) 

the even-numbered frequency samples are 

N~l 



X[2r] = J2 *WK {2r) > r = 0, 1, . . . , (N/2) - 1, (9.24) 



r«(2r) 

which can be expressed as 



(N/2)-l N-l 

X[2r] = J2 xWWn" + E *[«]*#". (9.25) 

n=0 n=N/2 

With a substitution of variables in the second summation in Eq. (9.25), we obtain 

(N/2)-l {N/2)-\ 

X[2r]= E x[n]W N nr + ^ ^[n + (N/2)]W 2 N r[n+{N/2)] . (9.26) 

«=0 n=0 
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Finally, because of the periodicity of W N rn , 

w 2r[n+(N/2)] = W 2rn w rN = jy2™ ^1) 

and since WjJ = W N/ 2, Eq. (9.26) can be expressed as 

(N/2)-l 

X[2r] = J2 (x[n]+x[n + (N/2)])W™ 2 , r = 0, 1, . . . , (N/2) - 1. (9.28) 

Equation (9.28) is the ( Af/2)-point DFT of the ( N/2)-point sequence obtained by adding 
the first half and the last half of the input sequence. Adding the two halves of the input 
sequence represents time aliasing, consistent with the fact that in computing only the 
even-numbered frequency samples, we are undersampling the Fourier transform of x[n]. 
We can now consider obtaining the odd-numbered frequency points, given by 

N-l 

X[2r + 1] = ^2x[n]W^ 2r+1 \ r = 0, 1 (N/2) - 1. (9.29) 

As before, we can rearrange Eq. (9.29) as 

(W)-l N-l 

X[2r + 1]= J2 xWK i2r+1) + Y, x[n]W^ 2r+1) . (9.30) 

n=0 n=N/2 

An alternative form for the second summation in Eq. (9.30) is 

N-l (N/2)-l 

Y, x[n]wf r+l) = £ x[n + (N/2)]W^ N/m2r+l) 

n-N/2 n=0 

(N/2)-l 

= w (N/2)(2M-i) g x[n + (N/2)]wf r+l) 

«=0 

(N/2)-\ 

= - £ x[n + (N/2)\wf r+x \ (9.31) 

where we have used the fact that W^ N/2)2r = 1 and W^ N/2) = -1. Substituting Eq. (9.31) 
into Eq. (9.30) and combining the two summations, we obtain 

(N/2)-l 

X[2r + 1]= Y, (x[n]-x[n + (N/2)])Wf r+ '\ (9.32) 

n=0 
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or, since Wh = W] 



N 



'N/2, 



(N/2)-l 



X[2r + 1] = Yl (*M " x l" + (^/2)1) WjJW^, 



n=0 



(9.33) 



r =0,1,..., (N/2) -1. 

Equation (9.33) is the (N/2)-point DFT of the sequence obtained by subtracting the 
second half of the input sequence from the first half and multiplying the resulting 
sequence by WjJ. Thus, on the basis of Eqs. (9.28) and (9.33), with g[n] — x[n] + 
x[n + N/2] and h[n] = x[n] — x[n + N/2], the DFT can be computed by first forming the 
sequences g[n] and h[n], then computing h[n] WjJ, and finally computing the (N/2)-point 
DFTs of these two sequences to obtain the even-numbered output points and the odd- 
numbered output points, respectively. The procedure suggested by Eqs. (9.28) and (9.33) 
is illustrated for the case of an 8-point DFT in Figure 9.17. 

Proceeding in a manner similar to that followed in deriving the decimation-in- 
time algorithm, we note that since N is a power of 2, N/2 is even; consequently, the 
(A72)-point DFTs can be computed by computing the even-numbered and odd num- 
bered output points for those DFTs separately. As in the case of the procedure leading 
to Eqs. (9.28) and (9.33), this is accomplished by combining the first half and the last 
half of the input points for each of the (A r /2)-point DFTs and then computing (N/4)- 
point DFTs. The flow graph resulting from taking this step for the 8-point example is 
shown in Figure 9.18. For the 8-point example, the computation has now been reduced 
to the computation of 2-point DFTs, which are implemented by adding and subtracting 
the input points, as discussed previously. Thus, the 2-point DFTs in Figure 9.18 can be 
replaced by the computation shown in Figure 9.19, so the computation of the 8-point 
DFT can be accomplished by the algorithm depicted in Figure 9.20. 

By counting the arithmetic operations in Figure 9.20 and generalizing to N = 2 v y 
we see that the computation of Figure 9.20 requires (N/2) log 2 N complex multiplica- 
tions and N\og 2 N complex additions. Thus, the total number of computations is the 
same for the decimation-in-frequency and the decimation-in-time algorithms. 
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Figure 9.17 Flow graph of 
decimation-in-frequency decomposition 
of an A/-point DFT computation into two 
(/l//2)-point DFT computations 
(0=8). 



Sec. 9.4 Decimation-in-Frequency FFT Algorithms 



649 




point 

DFT 



N 



point 



DFT 



point 

DFT 



point 

DFT 



■oX[0] 



■vX[4] 



■+— <>x[2] 



oX[l] 



■°X[5] 



-°A-[3] 



oX[l] 



Figure 9.18 Flow graph of 
decimation-in-frequency decomposition 
of an 8-point DFT into four 2-point DFT 
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Figure 9.19 Flow graph of a typical 
2-point DFT as required in the last stage 
of decimation-in-frequency 
decomposition. 
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9.4.1 In-Place Computation 

The flow graph in Figure 9.20 depicts one FFT algorithm based on decimation in fre- 
quency. We can observe a number of similarities and also a number of differences in 
comparing this graph with the flow graphs derived on the basis of decimation in time. 
As with decimation in time, of course, the flow graph of Figure 9.20 corresponds to a 
computation of the discrete Fourier transform, regardless of how the graph is drawn, 
as long as the same nodes are connected to each other with the proper branch trans- 
mittances. In other words, the flow graph of Figure 9.20 is not based on any assumption 
about the order in which the input sequence values are stored. However, as was done 
with the decimation-in-time algorithms, we can interpret successive vertical nodes in 
the flow graph of Figure 9.20 as corresponding to successive storage registers in a digital 
memory. In this case, the flow graph in Figure 9.20 begins with the input sequence in 
normal order and provides the output DFT in bit-reversed order. The basic computa- 
tion again has the form of a butterfly computation, although the butterfly is different 
from that arising in the decimation-in-time algorithms. However, because of the but- 
terfly nature of the computation, the flow graph of Figure 9.20 can be interpreted as an 
in-place computation of the discrete Fourier transform. 

9.4.2 Alternative Forms 

A variety of alternative forms for the decimation-in-frequency algorithm can be ob- 
tained by transposing the decimation-in-time forms developed in Section 9.3.2. If we 
denote the sequence of complex numbers resulting from the mth stage of the compu- 
tation as X m [^], where t — 0, 1 N — 1, and m = 1, 2, . . . , v, then the basic butterfly 

computation shown in Figure 9.21 has the form 

X m [p] = X m ., [p] + X m ., [ql (9.34a) 

X m [q] = (Xm^lp] - X m ^[q])W r N . (9.34b) 

By comparing Figures 9.11 and 9.21 or Eqs. (9.21) and (9.34), we see that the 
butterfly computations are different for the two classes of FFT algorithms. However, we 
also note a resemblance between the basic butterfly flow graphs of Figures 9.11 and 9.21 
and between the FFT flow graphs of Figures 9.10 and 9.20. Specifically, Figure 9.20 can be 
obtained from Figure 9.10 and Figure 9.21 from Figure 9.11 by reversing the direction 
of signal flow and interchanging the input and output. That is, in the terminology of 
Chapter 6, Figure 9.20 is the transpose of the flow graph in Figure 9.10, and Figure 9.21 
is the transpose of Figure 9.11. The application of the transposition theorem is not 
straightforward in this case, because the FFT flow graphs have more than one input 
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and output node. Nevertheless, it is true that the input-output characteristics of the 
flow graphs in Figures 9.10 and 9.20 are the same. This can be shown by noting that 
the butterfly equations in Eqs. (9.34) can be solved backward, starting with the output 
array. (Problem 9.23 outlines a proof of this result.) More generally, it is true that for 
each decimation-in-time FFT algorithm, there exists a decimation-in-frequency FFT 
algorithm that corresponds to interchanging the input and output and reversing the 
direction of all the arrows in the flow graph. 

This result implies that all the flow graphs of Section 9.3 have counterparts in the 
class of decimation-in-frequency algorithms. This, of course, also corresponds to the fact 
that, as before, it is possible to rearrange the nodes of a flow graph without altering the 
final result. 

Applying the transposition procedure to Figure 9.14 leads to Figure 9.22. In this 
flow graph, the output is in normal order and the input is in bit-reversed order. Alter- 
natively, the transpose of the flow graph of Figure 9.15 is the flow graph of Figure 9.23, 
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Figure 9.22 Flow graph of a 
decimation-in-frequency DFT algorithm 
obtained from Figure 9.20. Input in 
bit-reversed order and output in normal 
order. (Transpose of Figure 9.14.) 



Figure 9.23 Rearrangement of 
Figure 9.20 with both input and output 
in normal order. (Transpose of 
Figure 9.15.) 
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Figure 9.24 Rearrangement of 
Figure 9.20 having the same geometry 
for each stage, thereby permitting 
sequential data accessing and storage. 
(Transpose of Figure 9.16.) 



where both the input and the output are in normal order. As in the case of Figure 9.15, 
this flow graph does not correspond to an in-place computation. 

The transpose of Figure 9.16 is shown in Figure 9.24. Each stage of Figure 9.24 has 
the same geometry, a property that is desirable for computing large transforms using 
sequential data storage, as discussed before. 



9.5 PRACTICAL CONSIDERATIONS 

In Sections 9.3 and 9.4, we discussed the basic principles of efficient computation of the 
DFT when N is an integer power of 2. In these discussions, we favored the use of signal 
flow graph representations rather than explicitly writing out in detail the equations that 
such flow graphs represent. Of necessity, we have shown flow graphs for specific values 
of TV. However, by considering a flow graph such as that in Figure 9.10, for a specific 
value of N, it is possible to see how to structure a general computational algorithm that 
would apply to any N = 2 V . 

Although it is true that the flow graphs of the previous sections capture the essence 
of the FFT algorithms that they depict, a variety of details must be considered in the 
implementation of a given algorithm. In this section, we briefly suggest some of these. 
Specifically, in Section 9.5.1 we discuss issues associated with accessing and storing data 
in the intermediate arrays of the FFT. In Section 9.5.2 we discuss issues associated 
with computing or accessing the branch coefficients in the flow graph. Our emphasis 
is on algorithms for N a power of 2, but much of the discussion applies to the general 
case as well. For purposes of illustration, we focus primarily on the decimation-in-time 
algorithm of Figure 9.10. In Section 9.5.3 we briefly comment on algorithms for more 
general values of N. 



9.5.1 Indexing 

In the algorithm depicted in Figure 9.10, the input must be in bit-reversed order so 
that the computation can be performed in place. The resulting DFT is then in normal 
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order. Generally, sequences do not originate in bit-reversed order, so the first step in the 
implementation of Figure 9.10 is to sort the input sequence into bit-reversed order. As 
can be seen from that figure and Eqs. (9.20) and (9.22), bit-reversed sorting can be done 
in place, since samples are only pairwise interchanged; i.e., a sample at a given index is 
interchanged with the sample in the location specified by the bit-reversed index. This 
is conveniently done in place by using two counters, one in normal order and the other 
in bit-reversed order. The data in the two positions specified by the two counters are 
simply interchanged. Once the input is in bit-reversed order, we can proceed with the 
first stage of computation. In this case, the inputs to the butterflies are adjacent elements 
of the array Xq[-]. In the second stage, the inputs to the butterflies are separated by 2. In 
the mth stage, the butterfly inputs are separated by 2 m_1 . The coefficients are powers of 

( N/2'") 

W N in the mth stage and are required in normal order if computation of butterflies 
begins at the top of the flow graph of Figure 9.10. The preceding statements define the 
manner in which data must be accessed at a given stage, which, of course, depends on 
the flow graph that is implemented. For example, in the mth stage of Figure 9.14, the 
butterfly spacing is 2 v ~ m , and in this case the coefficients are required in bit-reversed 
order. The input is in normal order; however, the output is in bit-reversed order, so it 
generally would be necessary to sort the output into normal order by using a normal- 
order counter and a bit-reversed counter, as discussed previously. 

In general, if we consider all the flow graphs in Sections 9.3 and 9.4, we see that each 
algorithm has its own characteristic indexing problems. The choice of a particular algo- 
rithm depends on a number of factors. The algorithms utilizing an in-place computation 
have the advantage of making efficient use of memory. Two disadvantages, however, 
are that the kind of memory required is random-access rather than sequential memory 
and that either the input sequence or the output DFT sequence is in bit-reversed order. 
Furthermore, depending on whether a decimation-in-time or a decimation-in-frequency 
algorithm is chosen and whether the inputs or the outputs are in bit-reversed order, the 
coefficients are required to be accessed in either normal order or bit-reversed order. If 
non-random-access sequential memory is used, some fast Fourier transform algorithms 
utilize sequential memory, as we have shown, but either the inputs or the outputs must 
be in bit-reversed order. While the flow graph for the algorithm can be arranged so that 
the inputs, the outputs, and the coefficients are in normal order, the indexing structure 
required to implement these algorithms is complicated, and twice as much random ac- 
cess memory is required. Consequently, the use of such algorithms does not appear to 
be advantageous. 

The in-place FFT algorithms of Figures 9.10, 9.14, 9.20, and 9.22 are among the 
most commonly used. If a sequence is to be transformed only once, then bit-reversed 
sorting must be implemented on either the input or the output. However, in some 
situations a sequence is transformed, the result is modified in some way, and then 
the inverse DFT is computed. For example, in implementing FIR digital filters by 
block convolution using the discrete Fourier transform, the DFT of a section of the 
input sequence is multiplied by the DFT of the filter impulse response, and the result 
is inverse transformed to obtain a segment of the output of the filter. Similarly, in 
computing an autocorrelation function or cross-correlation function using the discrete 
Fourier transform, a sequence will be transformed, the DFTs will be multiplied, and 
then the resulting product will be inverse transformed. When two transforms are cas- 
caded in this way, it is possible, by appropriate choice of the FFT algorithms, to avoid the 
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need for bit reversal. For example, in implementing an FIR digital filter using the DFT, 
we can choose an algorithm for the direct transform that utilizes the data in normal 
order and provides a DFT in bit-reversed order. Either the flow graph corresponding 
to Figure 9.14, based on decimation in time, or that of Figure 9.20, based on decimation 
in frequency, could be used in this way. The difference between these two forms is that 
the decimation-in-time form requires the coefficients in bit-reversed order, whereas the 
decimation-in-frequency form requires the coefficients in normal order. 

In using either of these algorithms, the transform occurs in bit-reversed order. Con- 
sequently, in using the DFT for block convolution, if the DFT of the impulse response 
of the filter has been stored in bit-reversed order, the DFTs can simply be multiplied 
point by point in the order stored. For the inverse DFT, we can choose a form of the 
algorithm that requires bit-reversed data at the input and provides normally ordered 
results. Here, either the flow graph of Figure 9.10, based on decimation in time, or that 
of Figure 9.22, based on decimation in frequency, can be used. Figure 9.10, however, 
utilizes coefficients in normal order, whereas Figure 9.22 requires the coefficients in 
bit-reversed order. If the decimation-in-time form of the algorithm is chosen for the 
direct transform, then the decimation-in-frequency form of the algorithm should be 
chosen for the inverse transform, requiring coefficients in bit-reversed order. Likewise, 
the decimation-in-frequency algorithm for the direct transform should be paired with 
the decimation-in-time algorithm for the inverse transform, which would then utilize 
normally ordered coefficients. 

9.5.2 Coefficients 

We have observed that the coefficients W r N may be required in either bit-reversed order 
or in normal order. In either case we must store a table sufficient to look up all required 
values, or we must compute the values as needed. The first alternative has the advantage 
of speed, but of course requires extra storage. We observe from the flow graphs that we 
require W r N for r = 0, 1, . . . , (N/2) — 1. Thus, we require N/2 complex storage registers 
for a complete table of values of W^. 5 In the case of algorithms in which the coefficients 
are required in bit-reversed order, we can simply store the table in bit-reversed order. 
The computation of the coefficients as they are needed saves storage, but is less 
efficient than storing a lookup table. If the coefficients are to be computed, it is generally 
most efficient to use a recursion formula. At any given stage, the required coefficients 
are all powers of a complex number of the form JVjJ, where q depends on the algorithm 
and the stage. Thus, if the coefficients are required in normal order, we can use the 
recursion formula 

W$ = W q N • Wf~ 1} (9.35) 

to obtain the ^th coefficient from the (I — l)st coefficient. Clearly, algorithms that 
require coefficients in bit-reversed order are not well suited to this approach. It should 
be noted that Eq. (9.35) is essentially the coupled-form oscillator of Problem 6.21. When 
using finite-precision arithmetic, errors can build up in the iteration of this difference 

5 This number can be reduced using symmetry at the cost of greater complexity in accessing desired 
values. 
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equation. Therefore, it is generally necessary to reset the value at prescribed points 
(e.g., W N = — /") so that errors do not become unacceptable. 

9.5.3 Algorithms for More General Values of N 

Although the special case of N a power of 2 leads to algorithms that have a simple 
structure, this is not the only restriction on TV that can lead to a reduction in computation 
in the DFT. Indeed, in many cases it is desirable to evaluate the DFT efficiently for other 
values of TV, and the same principles that were applied in the power of 2 decimation-in- 
time and decimation-in-frequency algorithms can be employed when TV is a composite 
integer, i.e., the product of two or more integer factors. For example, if TV = RQ, it 
is possible to express an Appoint DFT as either the sum of R £>-point DFTs or as the 
sum of Q ^-point DFTs and thereby obtain reductions in the number of computations. 
If TV has many factors, the process can be repeated for each of the factors. Algorithms 
for general composite TV involve more complicated indexing than the power of 2 case. 
In some cases these algorithms are straightforward generalizations of the algorithms 
discussed in Sections 9.3 and 9.4, in which case they are called "Cooley-Tukey" type 
algorithms. If the factors of TV are relatively prime, the number of multiplications can be 
reduced at the cost of the more complicated indexing of a "prime factor" algorithm. The 
details of the more general Cooley-Tukey and prime factor algorithms are discussed in 
Burrus and Parks (1985), Burrus (1988), and Blahut (1985). 



9.6 IMPLEMENTATION OF THE DFT USING 
CONVOLUTION 

Because of the dramatic efficiency of the FFT, convolution is often implemented by 
explicitly computing the inverse DFT of the product of the DFTs of each sequence to be 
convolved, where an FFT algorithm is used to compute both the forward and the inverse 
DFTs. In contrast, and even in apparent (but, of course, not actual) contradiction, it is 
sometimes preferable to compute the DFT by first reformulating it as a convolution. 
We have already seen an example of this in the Goertzel algorithm. A number of other, 
more sophisticated, procedures are based on this approach. 

9.6.1 Overview of the Winograd Fourier Transform 
Algorithm 

One procedure proposed and developed by S. Winograd (1978), often referred to as 
the Winograd Fourier transform algorithm (WFTA), achieves its efficiency by express- 
ing the DFT in terms of polynomial multiplication or, equivalently, convolution. The 
WFTA uses an indexing scheme corresponding to the decomposition of the DFT into a 
multiplicity of short-length DFTs where the lengths are relatively prime. Then the short 
DFTs are converted into periodic convolutions. A scheme for converting a DFT into a 
convolution when the number of input samples is prime was proposed by Rader (1968), 
but its application awaited the development of efficient methods for computing periodic 
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convolutions. Winograd combined all of the foregoing procedures together with highly 
efficient algorithms for computing cyclic convolutions into a new approach to com- 
puting the DFT. The techniques for deriving efficient algorithms for computing short 
convolutions are based on relatively advanced number-theoretic concepts, such as the 
Chinese remainder theorem for polynomials, and consequently, we do not explore the 
details here. However, excellent discussions of the details of the WFTA are available 
in McClellan and Rader (1979), Blahut (1985), and Burrus (1988). 

With the WFTA approach, the number of multiplications required for an JV-point 
DFT is proportional to N rather than N log N. Although this approach leads to algo- 
rithms that are optimal in terms of minimizing multiplications, the number of additions 
is significantly increased in comparison with the FFT. Therefore, the WFTA is most 
advantageous when multiplication is significantly slower than addition, as is often the 
case with fixed-point digital arithmetic. However, in processors where multiplication 
and accumulation are tied together, the Cooley-Tukey or prime factor algorithms are 
generally preferable. Additional difficulties with the WFTA are that indexing is more 
complicated, in-place computation is not possible, and there are major structural dif- 
ferences in algorithms for different values of N. 

Thus, although the WFTA is extremely important as a benchmark for determining 
how efficient the DFT computation can be (in terms of number of multiplications), other 
factors often dominate in determining the speed and efficiency of a hardware or software 
implementation of the DFT computation. 



9.6.2 The Chirp Transform Algorithm 

Another algorithm based on expressing the DFT as a convolution is referred to as 
the chirp transform algorithm (CTA). This algorithm is not optimal in minimizing any 
measure of computational complexity, but it has been useful in a variety of applications, 
particularly when implemented in technologies that are well suited to doing convolu- 
tion with a fixed, prespecified impulse response. The CTA is also more flexible than the 
FFT, since it can be used to compute any set of equally spaced samples of the Fourier 
transform on the unit circle. 

To derive the CTA, we let x[n] denote an Appoint sequence and X(e^) its Fourier 
transform. We consider the evaluation of M samples of X(e j0} ) that are equally spaced 
in angle on the unit circle, as indicated in Figure 9.25, i.e., at frequencies 

(o k = coo + tcAco, fc = 0, 1, . . . , M - 1, (9.36) 

where the starting frequency coq and the frequency increment Aco can be chosen ar- 
bitrarily. (For the specific case of the DFT, o> = 0, M = N, and Aco = 2ji/N.) The 
Fourier transform corresponding to this more general set of frequency samples is given 
by 

N-l 

X(e jc ° k ) = J2 x[n]e-' 0,kn , k = 0, 1, . . . , M - 1, (9.37) 

or, with W defined as 

W=e-' Aa > (9.38) 
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Figure 9.25 Frequency samples for 
chirp transform algorithm. 



and using Eq. (9.36), 



N~\ 



X{e ja)k ) = J2 x i n ] e ~ jmnwni 



n=0 



To express X(e jc ° k ) as a convolution, we use the identity 

nk = \[n 2 + k 2 -(k-n) 2 ] 
to express Eq. (9.39) as 



N-\ 



X(e jWk ) = ^x[n\e- j< °» n W nl/2 W* /2 W- {k - n)2/2 . 



n=0 



Letting 



g[n]=x[n]e- jmn W n2/2 , 



we can then write 

X(e^) = W k2/2 I J^ g[n]W- {k -" )2/2 ) , k = 0, 1, . . . , M - 1. 



'N-l 



(9.39) 



(9.40) 



(9.41) 



(9.42) 



(9.43) 



,n=0 



In preparation for interpreting Eq. (9.43) as the output of a linear time-invariant system, 
we obtain more familiar notation by replacing k by n and n by k in Eq. (9.43): 



X(e>"») = W n2/2 ( Y, g[k]W- {n - k)2/2 j , n = 0, 1, . . . , 



M-\ 



(9.44) 



In the form of Eq. (9.44), X(e j( ° n ) corresponds to the convolution of the sequence 
g[n] with the sequence W~ n /2 , followed by multiplication by the sequence W n /2 . The 
output sequence, indexed on the independent variable n, is the sequence of frequency 
samples X(e j( ° n ). With this interpretation, the computation of Eq. (9.44) is as depicted in 
Figure 9.26. The sequence W~ n /2 can be thought of as a complex exponential sequence 
with linearly increasing frequency nAw. In radar systems, such signals are called chirp 
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signals — hence the name chirp transform. A system similar to Figure 9.26 is commonly 
used in radar and sonar signal processing for pulse compression (Skolnik, 1986). 

For the evaluation of the Fourier transform samples specified in Eq. (9.44), we 
need only compute the output of the system in Figure 9.26 over a finite interval. In 
Figure 9.27, we depict illustrations of the sequences g[n], W~ n /2 , and g[n] * W~ n /2 . 
Since g[n] is of finite duration, only a finite portion of the sequence W~ n /2 is used in 
obtaining g[n] * W~" /2 over the interval w = 0, 1,...,M— 1, specifically, that portion 
from n = —(N — 1) to n = M — 1. Let us define 



AM = / w "* 2/2 - -(N-l)<n<M-l, 
\ 0, otherwise, 



(9.45) 



as illustrated in Figure 9.28. It is easily verified by considering the graphical represen- 
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Figure 9.26 Block diagram of chirp 
transform algorithm. 
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Figure 9.27 An illustration of the sequences used in the chirp transform algo- 
rithm. Note that the actual sequences involved are complex valued, (a) g[n] - 

x[ri\e-i°>* n W n2 l 2 . (b) W~ n ^ 2 . (c) g[n] * W~ n2 / 2 . 
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tation of the process of convolution that 

g[n]*W-*' 2 =g[n]*h[n], 



h = 0,1,...,M-1. 



(9.46) 



Consequently, the infinite-duration impulse response W~ n /2 in the system of Figure 9.26 
can be replaced by the finite-duration impulse response of Figure 9.28. The system is 
now as indicated in Figure 9.29, where h[n] is specified by Eq. (9.45) and the frequency 
samples are given by 



X(e JM ") = y[n], n = 0, 1, . . . , M - 1. 



(9.47) 



Evaluation of frequency samples using the procedure indicated in Figure 9.29 has 
a number of potential advantages. In general, we do not require N = M as in the FFT 
algorithms, and neither TV nor M need be composite numbers. In fact, they may be 
prime numbers if desired. Furthermore, the parameter coq is arbitrary. This increased 
flexibility over the FFT does not preclude efficient computation, since the convolution 
in Figure 9.29 can be implemented efficiently using an FFT algorithm with the technique 
of Section 8.7 to compute the convolution. As discussed in that section, the FFT size 
must be greater than or equal to (M + N — l)in order that the circular convolution will 
be equal tog[n]*/t[n] for < n < M—\. The FFT size is otherwise arbitrary and can, for 
example, be chosen to be a power of 2. It is interesting to note that the FFT algorithms 
used to compute the convolution implied by the CTA could be of the Winograd type. 
These algorithms themselves use convolution to implement the DFT computation. 

In the system of Figure 9.29 h[n] is noncausal, and for certain real-time implemen- 
tations it must be modified to obtain a causal system. Since h[n] is of finite duration, 
this modification is easily accomplished by delaying h[n] by (N — 1) to obtain a causal 
impulse response: 



hi[n] = 



w -{n-N+lf/2 i w = 0,l,.. 

0, otherwise. 



,M+ N-2, 



(9.48) 



Since both the chirp demodulation factor at the output and the output signal are also 

h[n] 



(JV+1) 



(M-l) 



Figure 9.28 An illustration of the region of support for the FIR chirp filter. Note 
that the actual values of h[n] as given by Eq. (9.45) are complex. 
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Figure 9.29 Block diagram of chirp 
transform system for finite-length 
impulse response. 



660 



Computation of the Discrete Fourier Transform Chap. 9 



delayed by (N — 1) samples, the Fourier transform values are 

X(e j( °") = yi[n + TV - 1], n = 0, 1, . . . , M - 1. 



(9.49) 



Modifying the system of Figure 9.29 to obtain a causal system results in the system 
of Figure 9.30. An advantage of this system stems from the fact that it involves the convo- 
lution of the input signal (modulated with a chirp) with a fixed, causal impulse response. 
Certain technologies, such as charge-coupled devices (CCD) and surface acoustic wave 
(SAW) devices, are particularly useful for implementing convolution with a fixed, pre- 
specified impulse response. These devices can be used to implement FIR filters, with the 
filter impulse response being specified at the time of fabrication by a geometric pattern 
of electrodes. A similar approach was followed by Hewes et al. (1979) in implementing 
the CTA with CCDs. 

Further simplification of the CTA results when the frequency samples to be com- 
puted correspond to the DFT, i.e., when a>o = and W = e~ j2n,N , so that a> n = 2nn/N. 
In this case, it is convenient to modify the system of Figure 9.30. Specifically, with t^o = 
and W = e~ ]2jI/N = W#, consider applying an additional unit of delay to the impulse 
response in Figure 9.30. With N even, W§ = e j2jT = 1, so 



W 



-{n-Nf/2 



N 



= w 



-n 2 /2 
N 



(9.50) 



Therefore, the system now is as shown in Figure 9.31, where 



hi[n] = { J^ 



-n 2 /2 



n = 1,2, . 
otherwise. 



,M+N-\, 



(9.51) 



In this case, the chirp signal modulating x[n\ and the chirp signal modulating the output 
of the FIR filter are identical, and 



X{e j2nn i N ) = y2[n + N], n = 0, 1, . . . , M - 1, 



(9.52) 
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Figure 9.30 Block diagram of chirp 
transform system for causal finite-length 
impulse response. 
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Figure 9.31 Block diagram of chirp 
transform system for obtaining DFT 
samples. 
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Example 9.1 Chirp Transform Parameters 

Suppose we have a finite-length sequence x[n] that is nonzero only on the interval 
n = 0, . . . , 25, and we wish to compute 16 samples of the DTFT X(e^) at the fre- 
quencies cok = 2jt/27 + 2jr&/1024 for k = 0, . . . , 15. We can compute the desired 
frequency samples through convolution with a causal impulse response using the sys- 
tem in Figure 9.30 with an appropriate choice of parameters. We set M = 16, the 
number of samples desired, and N = 26, the length of the sequence. The frequency of 
the initial sample, coq, is 2jt/27, while the interval between adjacent frequency samples, 
Acq, is 2jt/1024. With these choices for the parameters, we know from Eq. (9.38) that 
W = e~i A(0 , and so the causal impulse response we desire is from Eq. (9.48) 



* lW = /[-™]-<" 



-(«-25) 2 /2 ; M= 0,...,40, 

otherwise. 



For this causal impulse response, the output y\ [n] will be the desired frequency samples 
beginning at y\ [25], i.e., 

yi[n + 25] = A r (e ;a,fl )L n= 2 7r /27+2^ n /i024, n = 0, . . . , 15. 

An algorithm similar to the CTA was first proposed by Bluestein (1970), who 
showed that a recursive realization of Figure 9.30 can be obtained for the case Aco = 
2tt/N, N a perfect square. (See Problem 9.41.) Rabiner et al. (1969) generalized this 
algorithm to obtain samples of the z-transform equally spaced in angle on a spiral con- 
tour in the z-plane. This more general form of the CTA was called the chirp 
z-transform (CZT) algorithm. The algorithm that we have called the CTA is a special 
case of the CZT algorithm. 

9.7 EFFECTS OF FINITE REGISTER LENGTH 

Since the fast Fourier transform algorithm is widely used for digital filtering and spec- 
trum analysis, it is important to understand the effects of finite register length in the 
computation. As in the case of digital filters, a precise analysis of the effects is difficult. 
However, a simplified analysis is often sufficient for the purpose of choosing the required 
register length. The analysis that we will present is similar in style to that carried out 
in Section 6.8. Specifically, we analyze arithmetic round-off by means of a linear-noise 
model obtained by inserting an additive noise source at each point in the computation 
algorithm where round-off occurs. Furthermore, we will make a number of assumptions 
to simplify the analysis. The results that we obtain lead to several simplified, but useful, 
estimates of the effect of arithmetic round-off. Although the analysis is for rounding, it 
is generally easy to modify the results for truncation. 

We have seen several different algorithmic structures for the FFT. However, the 
effects of round-off noise are very similar among the different classes of algorithms. 
Therefore, even though we consider only the radix-2 decimation-in-time algorithm, our 
results are representative of other forms as well. 

The flow graph depicting a decimation-in-time algorithm for N = 8 was shown 
in Figure 9.10 and is reproduced in Figure 9.32. Some key aspects of this diagram are 
common to all standard radix-2 algorithms. The DFT is computed in v = log 2 N stages. 
At each stage a new array of N numbers is formed from the previous array by linear 
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Figure 9.32 Flow graph for 
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Figure 9.33 Butterfly computation for 
decimation in time. 



combinations of the elements, taken two at a time. The uth array contains the desired 
DFT. For radix-2 decimation-in-time algorithms, the basic 2-point DFT computation is 
of the form 



X m [p] = X m _ x [p] + W r N X m - X [ql 
X m [q\ = X m _ x [p\ - W^X^lq]. 



(9.53a) 
(9.53b) 



Here the subscripts m and (m — 1) refer to the mth array and the (m — l)st array, 
respectively, and p and q denote the location of the numbers in each array. (Note that 
m = refers to the input array and m = v refers to the output array.) A flow graph 
representing the butterfly computation is shown in Figure 9.33. 

At each stage, N/2 separate butterfly computations are carried out to produce the 
next array. The integer r varies with p, q, and m in a manner that depends on the specific 
form of the FFT algorithm used. However, our analysis is not tied to the specific way 
in which r varies. Also, the specific relationship among p, q, and m, which determines 
how we index through the mth array, is not important for the analysis. The details of 
the analysis for decimation in time and decimation in frequency differ somewhat due 
to the different butterfly forms, but the basic results do not change significantly. In our 
analysis we assume a butterfly of the form of Eqs. (9.53a) and (9.53b), corresponding 
to decimation in time. 

We model the round-off noise by associating an additive noise generator with each 
fixed-point multiplication. With this model, the butterfly of Figure 9.33 is replaced by 
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r Figure 9.34 Linear-noise model for 

x r i Q ^ ^ s p x^ x f i fixed-point round-off noise in a 

m - lL£/Jt " v -i ml9J decimation-in-time butterfly 

€ t m '^] computation. 

that of Figure 9.34 for analyzing the round-off noise effects. The notation e[m t q] repre- 
sents the complex-valued error introduced in computing the mth array from the (m— l)st 
array; specifically, it indicates the error resulting from quantization of multiplication of 
the qth element of the (m — l)st array by a complex coefficient. 

Since we assume that, in general, the input to the FFT is a complex sequence, 
each of the multiplications is complex and thus consists of four real multiplications. We 
assume that the errors due to each real multiplication have the following properties: 

1. The errors are uniformly distributed random variables over the range —(1/2) • 2~ B 
to (1/2) • 2 _B , where, as defined in Section 6.6.1, numbers are represented as 
(B + l)-bit signed fractions. Therefore, each error source has variance 2~ 2fl /12. 

2. The errors are uncorrelated with one another. 

3. All the errors are uncorrelated with the input and, consequently, also with the 
output. 

Since each of the four noise sequences is uncorrelated zero-mean white noise and all 
have the same variance, 

2~2B 

£{\e[m, q}\ 2 } = 4 • — = I • 2~ 2B = a 2 B . (9.54) 

To determine the mean-square value of the output noise at any output node, we must 
account for the contribution from each of the noise sources that propagate to that node. 
We can make the following observations from the flow graph of Figure 9.32: 

1. The transmission function from any node in the flow graph to any other node to 
which it is connected is multiplication by a complex constant of unity magnitude 
(because each branch transmittance is either unity or an integer power of W/v). 

2. Each output node connects to seven butterflies in the flow graph. (In general, each 
output node would connect to (N — 1) butterflies.) For example, Figure 9.35(a) 
shows the flow graph with all the butterflies removed that do not connect to ^[0], 
and Figure 9.35(b) shows the flow graph with all the butterflies removed that do 
not connect to X[2]. 

These observations can be generalized to the case of TV an arbitrary power of 2. 

As a consequence of the first observation, the mean-square value of the magnitude 
of the component of the output noise due to each elemental noise source is the same and 
equal to o\. The total output noise at each output node is equal to the sum of the noise 
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Figure 9.35 (a) Butterflies that affect 
X [0]; (b) butterflies that affect X [2]. 
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propagated to that node. Since we assume that all the noise sources are uncorrected, 
the mean-square value of the magnitude of the output noise is equal to a\ times the 
number of noise sources that propagate to that node. At most one complex noise source 
is introduced at each butterfly; consequently, from observation 2, at most (TV — 1) noise 
sources propagate to each output node. In fact, not all the butterflies generate round-off 
noise, since some (for example, all those in the first and second stages for N = 8) involve 
only multiplication by unity. However, if for simplicity we assume that round-off occurs 
for each butterfly, we can consider the result as an upper bound on the output noise. 
With this assumption, then, the mean square value of the output noise in the Ath DFT 
value, F[k], is given by 

S{\F[k]\ 2 } = (N-l)cr 2 B , (9.55) 

which, for large N, we approximate as 

E{\F[k]\ 2 } = N<y 2 . (9.56) 

According to this result, the mean-square value of the output noise is proportional to 
N, the number of points transformed. The effect of doubling N, or adding another stage 
in the FFT, is to double the mean-square value of the output noise. In Problem 9.45, we 
consider the modification of this result when we do not insert noise sources for those 
butterflies that involve only multiplication by unity or j. Note that for FFT algorithms, 
a double-length accumulator does not help us reduce round-off noise, since the outputs 
of the butterfly computation must be stored in (B+ l)-bit registers at the output of each 
stage. 

In implementing an FFT algorithm with fixed-point arithmetic, we must ensure 
against overflow. From Eqs. (9.53a) and (9.53b), it follows that 

maxd^xb]!, |AT m _ite]|) < max(\X m [p]l \X m [q]\) (9.57) 

and also 

max(|Ar w [p]|, \X m [q]\) < 2max(|AT ffl _ 1 [p]|, |^ m _iMl). (9.58) 

(See Problem 9.44.) Equation (9.57) implies that the maximum magnitude is non de- 
creasing from stage to stage. If the magnitude of the output of the FFT is less than unity, 
then the magnitude of the points in each array must be less than unity, i.e., there will be 
no overflow in any of the arrays. 6 

To express this constraint as a bound on the input sequence, we note that the 
condition 

I*MI<^. 0<n<N-l, (9.59) 

is both necessary and sufficient to guarantee that 

|*[A:]|<1, Q<k<N-l. (9.60) 

This follows from the definition of the DFT, since 

N-l N-l 

\X[k]\ = \^x[n]W N n \<Y,\*W\ * = 0,l,...Ar-l. (9.61) 

n=0 n=0 

6 Actually, one should discuss overflow in terms of the real and imaginary parts of the data rather than 
the magnitude. However, |jc| < 1 implies that |7£e{je)| < 1 and |Jm{:E}| < 1, and only a slight increase in 
allowable signal level is achieved by scaling on the basis of real and imaginary parts 
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Thus, Eq. (9.59) is sufficient to guarantee that there will be no overflow for all stages of 
the algorithm. 

To obtain an explicit expression for the noise-to-signal ratio at the output of the 
FFT algorithm, consider an input in which successive sequence values are uncorrelated, 
i.e., a white-noise input signal. Also, assume that the real and imaginary parts of the 
input sequence are uncorrelated and that each has an amplitude density that is uniform 
between -l/(*JlN) and +l/(«</2N). (Note that this signal satisfies Eq. 9.59.) Then the 
average squared magnitude of the complex input sequence is 

£ (I*MI 2 > = 3775=°* 2 - ( 9 - 62 > 

The DFT of the input sequence is 

N-l 

X[k] = Y^*[n]W kn , (9.63) 

from which it can be shown that, under the foregoing assumptions on the input, 

N-l 

£{\x[q\ 2 ) = Y,£i\xln]\ 2 W k ''\ 2 

n =o (9.64) 

Combining Eqs. (9.56) and (9.64), we obtain 

= 3N 2 a^ = N l 2- ia . (9.65) 



£{|^l*|l / ->iw2_2 \ T 2^-2B 



£{\X[k]\ 2 ) 

According to Eq. (9.65), the noise-to-signal ratio increases as N 2 , or 1 bit per stage. 
That is, if N is doubled, corresponding to adding one additional stage to the FFT, then 
to maintain the same noise-to-signal ratio, 1 bit must be added to the register length. 
The assumption of a white-noise input signal is, in fact, not critical here. For a variety of 
other inputs, the noise -to-signal ratio is still proportional to N 2 , with only the constant 
of proportionality changing. 

Equation (9.58) suggests an alternative scaling procedure. Since the maximum 
magnitude increases by no more than a factor of 2 from stage to stage, we can prevent 
overflow by requiring that \x[n]\ < 1 and incorporating an attenuation of \ at the input 
to each stage. In this case, the output will consist of the DFT scaled by 1/N. Although 
the mean-square output signal will be 1/JV times what it would be if no scaling were 
introduced, the input amplitude can be N times larger without causing overflow. For 
the white-noise input signal, this means that we can assume that the real and imaginary 
parts are uniformly distributed from — 1/V2 to 1/V2, so that |jc[«]| < 1. Thus, with 
the v divisions by 2, the maximum expected value of the magnitude squared of the 
DFT that can be attained (for the white input signal) is the same as that given in 
Eq. (9.64). However, the output noise level will be much less than in Eq. (9.56), since 
the noise introduced at early stages of the FFT will be attenuated by the scaling that 
takes place in the later arrays. Specifically, with scaling by 1/2 introduced at the input 
to each butterfly, we modify the butterfly of Figure 9.34 to that of Figure 9.36, where, 
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e[m,p\ 



k m-l 



v m-\ 




e[m, q] 



Figure 9.36 Butterfly showing scaling 
multipliers and associated fixed- point 
round-off noise. 



in particular, two noise sources are now associated with each butterfly. As before, we 
assume that the real and imaginary parts of these noise sources are uncorrected and 
are also uncorrected with the other noise sources and that the real and imaginary parts 
are uniformly distributed between ±(1/2) • 2~ B . Thus, as before, 



E{\e[m, q]\ 2 } = a\ = \ . 2~ 2B = 8{\s[m, p]\ 2 }. 



(9.66) 



Because the noise sources are all uncorrelated, the mean-squared magnitude of the 
noise at each output node is again the sum of the mean-squared contributions of each 
noise source in the flow graph. However, unlike the previous case, the attenuation that 
each noise source experiences through the flow graph depends on the array at which 
it originates. A noise source originating at the mth array will propagate to the output 
with multiplication by a complex constant with magnitude (1/2)" - " 1-1 . By examination 
of Figure 9.32, we see that for the case N = 8, each output node connects to: 

1 butterfly originating at the (v — l)st array, 

2 butterflies originating at the (v — 2)nd array, 

4 butterflies originating at the (v — 3)rd array, etc. 

For the general case with N = 2 V , each output node connects to 2 v ~ m ~ l butterflies 
and therefore to 2 v ~ m noise sources that originate at the mth array. Thus, at each output 
node, the mean-square magnitude of the noise is 

£{|F[*]| 2 } = al£2»-".(0.5) 2 " 



-2m-2 



m=0 
v-l 



= al £(0.5)- 
= ai- 2^0.5 
B 1 - 0.5 



1-2 



(9.67) 



= 4al(l - 0.5"). 



For large N, we assume that 0.5 V (i.e., l/N)is negligible compared with unity, so 



S{\F[k]\ 2 }=4a 2 B = \'2 



-2B 



(9.68) 
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which is much less than the noise variance resulting when all the scaling is carried out 
on the input data. 

Now we can combine Eq. (9.68) with Eq. (9.64) to obtain the output noise-to-signal 
ratio for the case of step-by-step scaling and white input. We obtain 

fpjjjly = 12M4 = AN ■ 2- 28 , (9.69) 

a result proportional to N rather than to TV 2 . An interpretation of Eq. (9.69) is that 
the output noise-to-signal ratio increases as TV, corresponding to half a bit per stage, a 
result first obtained by Welch (1969). It is important to note again that the assumption 
of a white-noise signal is not essential in the analysis. The basic result of an increase of 
half a bit per stage holds for a broad class of signals, with only the constant multiplier 
in Eq. (9.69) being dependent on the signal. 

We should also note that the dominant factor that causes the increase of the noise- 
to-signal ratio with N is the decrease in signal level (required by the overflow constraint) 
as we pass from stage to stage. According to Eq. (9.68), very little noise (only a bit or 
two) is present in the final array. Most of the noise has been shifted out of the binary 
word by the scalings. 

We have assumed straight fixed-point computation in the preceding discussion; 
i.e., only preset attenuations were allowed, and we were not permitted to rescale on 
the basis of an overflow test. Clearly, if the hardware or programming facility is such 
that straight fixed-point computation must be used, we should, if possible, incorporate 
attenuators of 1/2 at each array rather than use a large attenuation of the input array. 

A third approach to avoiding overflow is the use of block floating point. In this 
procedure the original array is normalized to the far left of the computer word, with the 
restriction that \x[n]\ < 1; the computation proceeds in a fixed-point manner, except 
that after every addition there is an overflow test. If overflow is detected, the entire 
array is divided by 2 and the computation continues. The number of necessary divisions 
by 2 are counted to determine a scale factor for the entire final array. The output noise- 
to-signal ratio depends strongly on how many overflows occur and at what stages of the 
computation they occur. The positions and timing of overflows are determined by the 
signal being transformed; thus, to analyze the noise-to-signal ratio in a block floating- 
point implementation of the FFT, we would need to know the input signal. 

The preceding analysis shows that scaling to avoid overflow is the dominant factor 
in determining the noise-to-signal ratio of fixed-point implementations of FFT algo- 
rithms. Therefore, floating-point arithmetic should improve the performance of these 
algorithms. The effect of floating-point round-off on the FFT was analyzed both the- 
oretically and experimentally by Gentleman and Sande (1966), Weinstein (1969), and 
Kaneko and Liu (1970). These investigations show that, since scaling is no longer neces- 
sary, the decrease of noise-to-signal ratio with increasing TV is much less dramatic than 
for fixed-point arithmetic. 

For example, Weinstein (1969a) showed theoretically that the noise-to-signal ratio 
is proportional to v for N = 2", rather than proportional to N as in the fixed-point case. 
Therefore, quadrupling v (raising N to the fourth power) increases the noise-to-signal 
ratio by only 1 bit. 
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9.8 SUMMARY 

In this chapter we have considered techniques for computation of the discrete Fourier 
transform, and we have seen how the periodicity and symmetry of the complex factor 
e -j(2n/N)kn can ^ e exploited to increase the efficiency of DFT computations. 

We considered the Goertzel algorithm and the direct evaluation of the DFT ex- 
pression because of the importance of these techniques when not all N of the DFT values 
are required. However, our major emphasis was on fast Fourier transform (FFT) al- 
gorithms. We described the decimation-in-time and decimation-in-frequency classes of 
FFT algorithms in some detail and some of the implementation considerations, such as 
indexing and coefficient quantization. Much of the detailed discussion concerned algo- 
rithms that require N to be a power of 2, since these algorithms are easy to understand, 
simple to program, and most often used. 

The use of convolution as the basis for computing the DFT was briefly discussed. 
We presented a brief overview of the Winograd Fourier transform algorithm, and in 
somewhat more detail we discussed an algorithm called the chirp transform algorithm. 

The final section of the chapter discussed effects of finite word length in DFT 
computations. We used linear-noise models to show that the noise-to-signal ratio of 
a DFT computation varies differently with the length of the sequence, depending on 
how scaling is done. We also commented briefly on the use of floating-point represen- 
tations. 



PROBLEMS 



Basic Problems with Answers 

9.1. Suppose that a computer program is available for computing the DFT 

JV-1 



X[k] = Y^ x[n\e-i {2n/N)k \ k = 0, 1, . . . , N - 1; 



n=0 



i.e., the input to the program is the sequence x[n] and the output is the DFT X[k\. Show 
how the input and/or output sequences may be rearranged such that the program can also 
be used to compute the inverse DFT 



N-\ 



x[n] =jj^2 x W ei{2 * /N)kn > w = 0, 1, . . . , AT - 1; 

Jt=0 



i.e., the input to the program should be X[k] or a sequence simply related to X[k], and the 
output should be either x[n] or a sequence simply related to x[n]. There are several possible 
approaches. 

9.2. Figure P9.2-1 shows the graph representation of a decimation-in-time FFT algorithm for 
N = 8. The heavy line shows a path from sample x[l] to DFT sample X[2]. 
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Figure P9.2-1 



(a) What is the "gain" along the path that is emphasized in Figure P9.2-1? 

(b) How many other paths in the flow graph begin at x[l] and end at ^[2]? Is this true 
in general? That is, how many paths are there between each input sample and each 
output sample? 

(c) Now consider the DFT sample X [2]. By tracing paths in the flow graph of Figure P9.2-1 , 
show that each input sample contributes the proper amount to the output DFT sample; 
i.e., verify that 



JV-l 



X[2] = Y, x W e ~ }i2n 



/N)2n 



n=0 



9.3. Figure P9.3-1 shows the flow graph for an 8-point decimation-in-time FFT algorithm. Let 
x[n] be the sequence whose DFT is X[k]. In the flow graph, A[], #[■], C[], and D[-] 
represent separate arrays that are indexed consecutively in the same order as the indicated 
nodes. 

(a) Specify how the elements of the sequence x[n] should be placed in the array A[r], r = 

0, 1 7. Also, specify how the elements of the DFT sequence should be extracted 

from the array D[r], r = 0,1, ... ,1. 

(b) Without determining the values in the intermediate arrays, B[] and C[], determine 
and sketch the array sequence D[r], r = 0, 1, . . . , 7, if the input sequence is x[n] = 
(-W N y\/i = 0,l,...,7. 

(c) Determine and sketch the sequence C[r], r = 0, 1, . . . , 7, if the output Fourier trans- 
form is X [k] = 1 , k = 0, 1 ,..., 7. 
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Figure P9.3-1 



9.4. In implementing an FFT algorithm, it is sometimes useful to generate the powers of Wm 
with a recursive difference equation, or oscillator. In this problem we consider a radix-2 
decimation-in-time algorithm for N = 2 V . Figure 9.10 depicts this type of algorithm for 
N = 8. To generate the coefficients efficiently, the frequency of the oscillator would change 
from stage to stage. 

Assume that the arrays are numbered through v = log 2 N, so the array holding the 
initial input sequence is the zeroth array and the DFT is in the vth array. In computing the 
butterflies in a given stage, all butterflies requiring the same coefficients W r N are evaluated 
before obtaining new coefficients. In indexing through the array, we assume that the data in 
the array are stored in consecutive complex registers numbered through (TV — 1). All the 
following questions are concerned with the computation of the mth array from the (m - 1 )st 
array, where 1 < m < v. Answers should be expressed in terms of m. 

(a) How many butterflies must be computed in the wth stage? How many different coef- 
ficients are required in the mth stage? 

(b) Write a difference equation whose impulse response h[n] contains the coefficients W r N 
required by the butterflies in the wth stage. 

(c) The difference equation from Part (b) should have the form of an oscillator, i.e., h[n] 
should be periodic for n > 0. What is the period of h[n]l Based on this, write an 
expression for the frequency of this oscillator as a function of m. 

9.5. Computing the DFT generally requires complex multiplications. Consider the product 
X+ jY= (A+ jB)(C + jD) = (AC- BD) + j(BC + A D). In this form, a complex mul- 
tiplication requires four real multiplications and two real additions. Verify that a complex 
multiplication can be performed with three real multiplications and five additions using 
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the algorithm 

X= (A- B)D + {C-D)A 
Y=(A-B)D + {C+D)B. 

9.6. Consider the butterfly in Figure P9.6-1 . This butterfly was extracted from a signal flow graph 
implementing an FFT algorithm. Choose the most accurate statement from the following 
list: 

1. The butterfly was extracted from a decimation-in-time FFT algorithm. 

2. The butterfly was extracted from a decimation-in-frequency FFT algorithm. 

3. It is not possible to say from the figure which kind of FFT algorithm the butterfly 
came from. 




Figure P9.6-1 

9.7. Consider the system shown in Figure P9.7-1. If the input to the system, x[n], is a 32-point 
sequence in the interval < n < 31, the output y[n] at n = 32 is equal to X(e^) evaluated 
at a specific frequency u>k- What is cok for the coefficients shown in Figure P9.7-1? 




Figure P9.7-1 

9.8. A finite-length signal x[n] is nonzero in the interval < n < 19. This signal is the input to 
the system shown in Figure P9.8-1, where 



h[n] = 



e J(2n/21)(n-l9f/2^ „ = , 1, . . . , 28, 



0, 



otherwise. 



W = e ~ i{l7Tl2l) 



The output of the system, y[n], for the interval n = 19 28 can be expressed in terms of 

the DTFT X(e^) for appropriate values of co. Write an expression for y[n] in this interval 
in terms of X(e> w ). 



x[n] 



^ 


h[n] 


>r 


t 


S 









y[«] 



e -j(2Ttn)n W n 2 !2 



W (n 19) 2 /2 



Figure P9.8-1 
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9.9. The butterfly flow graph in Figure 9.9 can be used to compute the DFT of a sequence of 
length N = 2 V "in-place," i.e., using a single array of complex-valued registers. Assume this 
array of registers A[£] is indexed on < / < N — 1. The input sequence is initially stored 
in A[l\ in bit-reversed order. The array is then processed by v stages of butterflies. Each 
butterfly takes two array elements A[€q] and A[l\\ as inputs, then stores its outputs into 
those same array locations. The values of £q and l\ depend on the stage number and the 
location of the butterfly in the signal flow graph. The stages of the computation are indexed 
by m = 1, . . . , v. 

(a) What is \£i — io\ as a function of the stage number m? 

(b) Many stages contain butterflies with the same "twiddle" factor Wjy. For these stages, 
how far apart are the values of ^o for the butterflies with the same W r N ? 

9.10. Consider the system shown in Figure P9.10-1, with 

( e J{2n/lO)(n-U) 2 /2 



n = 0.1.. 
otherwise. 



15, 



It is desired that the output of the system, y[n + 11] = X(e j(V »), where co n = (2^/19) + 
n(2jz/l0)forn = 0, . . . ,4. Give the correct value for the sequence r[n] in Figure P9. 10-1 such 
that the output y[n] provides the desired samples of the discrete-time Fourier transform. 



x[n] 



■& 



h[n] 



■0 



y[n] 



r n 



e ~j(2n!\0)(n-U) 2 /2 



Figure P9.10-1 

9.11. Assume that you wish to sort a sequence x[n] of length N == 16 into bit-reversed order for 
input to an FFT algorithm. Give the new sample order for the bit-reversed sequence. 

9.12. For the following statement, assume that the sequence x[n] has length N = V and that 
X[k] is the JV-point DFT of x[n]. Indicate whether the statement is true or false, and justify 
your answer. 

Statement: It is impossible to construct a signal flow graph to compute X [k] from 
x[n] such that both x[n] and X[k] are in normal sequential (not bit-reversed) order, 

9.13. The butterfly in Figure P9.13-1 was taken from a decimation-in-frequency FFT with N — 16, 
where the input sequence was arranged in normal order. Note that a 16-point FFT will have 
four stages, indexed m = 1, . . . , 4. Which of the four stages have butterflies of this form? 
Justify your answer. 




Figure P9.13-1 

9.14. The butterfly in Figure P9.14-1 was taken from a decimation-in-time FFT with N — 16. 
Assume that the four stages of the signal flow graph are indexed by m = 1, . . . , 4. What are 
the possible values of r for each of the four stages. 
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Figure P9.14-1 



9.15. Suppose you have two programs for computing the DFT of a sequence x[n] that has N — 2 V 
nonzero samples. Program A computes the DFT by directly implementing the definition 
of the DFT sum from Eq. (8.67) and takes N 2 seconds to run. Program B implements 
the decimation-in-time FFT algorithm and takes ION log 2 jV seconds to run. What is the 
shortest sequence N such that Program B runs faster than Program A? 

9.16. The butterfly in Figure P9.16-1 was taken from a decimation-in-time FFT with N = 16. 
Assume that the four stages of the signal flow graph are indexed by m = 1, . . . , 4. Which 
of the four stages have butterflies of this form? 




Figure P9.16-1 

9.17. Suppose you are told that an N = 32 FFT algorithm has a "twiddle" factor of W 32 for one 
of the butterflies in its fifth (last) stage. Is the FFT a decimation-in-time or decimation-in- 
frequency algorithm? 

9.18. Suppose you have a signal x[n] with 1021 nonzero samples whose discrete-time Fourier 
transform you wish to estimate by computing the DFT. You find that it takes your computer 
100 seconds to compute the 1021-point DFT of x[n]. You then add three zero-valued samples 
at the end of the sequence to form a 1024-point sequence x\ [n]. The same program on your 
computer requires only 1 second to compute ^[fc]. Reflecting, you realize that by using 
-*iKI, y° u are a ble to compute more samples of X(e^ w ) in a much shorter time by adding 
some zeros to the end of x[n] and pretending that the sequence is longer. How do you 
explain this apparent paradox? 

9.19. Consider the signal flow graph in Figure P9.19-1. Suppose that the input to the system x[n] 
is an 8-point sequence. Choose the values of a and b such that y[S] = X(e^ 6n/S ). 




Figure P9.19-1 



9.20. Suppose that you time-reverse and delay a real- valued 32-point sequence x[n] to obtain 
x\[n] = jc[32 — n]. If xi[n] is used as the input for the system in Figure P9.7-1, find an 
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expression for y[32] in terms of X(e^), the discrete-time Fourier transform of the original 
sequence x[n]. 



Basic Problems 

9.21. In Section 9.2, we used the fact that W^ kN = 1 to derive a recurrence algorithm for 
computing a specific DFT value X[k] for a finite-length sequence x[n], n = 0, 1, . . . , N~ 1. 
(a) Using the fact that Wfc N = W$ n = 1, show that X[N—k] can be obtained as the output 

after N iterations of the difference equation depicted in Figure P9.21-1. That is, show 

that 

X[N-k] = y k [N]. 




Figure P9.21-1 

(b) Show that X[N — k] is also equal to the output after N iterations of the difference 
equation depicted in Figure P9.21 -2. Note that the system of Figure P9.21 -2 has the same 
poles as the system in Figure 9.2, but the coefficient required to implement the complex 
zero in Figure P9.21-2 is the complex conjugate of the corresponding coefficient in 
Figure 9.2; i.e., W„ k = (W*)*. 




Figure P9.21 -2 

9.22. Construct a flow graph for a 16-point radix-2 decimation-in-time FFT algorithm. Label all 
multipliers in terms of powers of W\^, and also label any branch transmittances that are 
equal to —1. Label the input and output nodes with the appropriate values of the input 
and DFT sequences, respectively. Determine the number of real multiplications and the 
number of real additions required to implement the flow graph. 



Advanced Problems 



9.23. In Section 9.4.2, it was asserted that the transpose of the flow graph of an FFT algorithm 
is also the flow graph of an FFT algorithm. The purpose of this problem is to develop that 
result for radix-2 FFT algorithms. 
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(a) The basic butterfly for the decimation-in-frequency radix-2 FFT algorithm is depicted in 
Figure P9.23-1. This flow graph represents the equations 

X m [p\ = X m ^[p] + X m -i[q], 
X m [q] = (X m -i[p] - X m -i[q])W r N . 

Starting with these equations, show that X m -\[p\ and X m -\[q] can be computed from 
^Gn[p] and X m [q], respectively, using the butterfly shown in Figure P 9,23-2. 



X m - ib] Qr * 70 » o X m \p\ 




x W N 

X m - \\q\ &■ *- ^ » o X m [q] 



X M° — * — °t — * 7>X m _ x \p] 



Figure P9.23-1 




Figure P9.23-2 

(b) In the decimation-in-frequency algorithm of Figure 9.20, A\,[r], r = 0, 1, . . . , N — 1 is 
the DFT X[k] arranged in bit-reversed order, and Xo[r] — x[r], r = 0, 1, . . . , N — 1; 
i.e., the zeroth array is the input sequence arranged in normal order. If each butterfly 
in Figure 9.20 is replaced by the appropriate butterfly of the form of Figure P9.23-2, 
the result would be a flow graph for computing the sequence x[n] (in normal order) 
from the DFT X[k] (in bit-reversed order). Draw the resulting flow graph for N = 8, 

(c) The flow graph obtained in Part (b) represents an inverse DFT algorithm, i.e., an 
algorithm for computing 

1 N ~ l 
x[n] =^J2 x l k \ W N k "> * = 0, 1, . . . , JV - 1. 

n=0 

Modify the flow graph obtained in Part (b) so that it computes the DFT 
X[k] = ^2 *M w Jv". * = 0, 1, . . . , AT - 1, 

n=0 

rather than the inverse DFT. 

(d) Observe that the result in Part (c) is the transpose of the decimation-in-frequency 
algorithm of Figure 9.20 and that it is identical to the decimation-in-time algorithm 
depicted in Figure 9.10. Does it follow that, to each decimation-in-time algorithm (e.g., 
Figures 9.14—9.16), there corresponds a decimation-in-frequency algorithm that is the 
transpose of the decimation-in-time algorithm and vice versa? Explain. 

9.24. We have seen that an FFT algorithm can be viewed as an interconnection of computational 
elements called butterflies. For example, the butterfly for a radix-2 decimation-in-frequency 
FFT algorithm is shown in Figure P9.24-1. The butterfly takes two complex numbers as in- 
put and produces two complex numbers as output. Its implementation requires a complex 
multiplication by WJ, where r is an integer that depends on the location of the butterfly in 
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the flow graph of the algorithm. Since the complex multiplier is of the form W^ = e id , the 
CORDIC rotator algorithm (see Problem 9.39) can be used to implement the complex mul- 
tiplication efficiently. Unfortunately, while the CORDIC rotator algorithm accomplishes 
the desired change of angle, it also introduces a fixed magnification that is independent 
of the angle 0. Thus, if the CORDIC rotator algorithm were used to implement the mul- 
tiplications by Wft, the butterfly of Figure P9.24-1 would be replaced by the butterfly of 
Figure P9.24-2, where G represents the fixed magnification factor of the CORDIC rota- 
tor. (We assume no error in approximating the angle of rotation.) If each butterfly in the 
flow graph of the decimation-in-frequency FFT algorithm is replaced by the butterfly of 
Figure P9.24-2, we obtain a modified FFT algorithm for which the flow graph would be as 
shown in Figure P9.24-3 for N = 8. The output of this modified algorithm would not be the 
desired DFT. 
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Figure P9.24-1 
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Figure P9.24-3 
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(a) Show that the output for the modified FFT algorithm is Y [k] = W[/c] AT[Jfc], where X[k] 
is the correct DFT of the input sequence x[n] and W[k] is a function of G, N, and k. 

(b) The sequence W[k] can be described by a particularly simple rule. Find this rule and 
indicate its dependence on G, N, and k. 

(c) Suppose that we wish to preprocess the input sequence x[n] to compensate for the 
effect of the modified FFT algorithm. Determine a procedure for obtaining a sequence 
x[n] from x[n] such that if x[n] is the input to the modified FFT algorithm, then the 
output will be X\k], the correct DFT of the original sequence x[ri\. 

9.25. This problem deals with the efficient computation of samples of the ^-transform of a finite- 
length sequence. Using the chirp transform algorithm, develop a procedure for computing 
values of X(z) at 25 points spaced uniformly on an arc of a circle of radius 0.5, beginning at 
an angle of — n/6 and ending at an angle of 2jt/3. The length of the sequence is 100 samples. 

9.26. The Af-point DFT of the Appoint sequence x[n] = e~^ n/N>>n , for N even, is 

X[k] = ^/Ne-i n/4 e i(n/N)k \ 

Determine the 2A r -point DFT of the 2JV-point sequence y[n] = e~ j ^ /N ^ n , assuming that 
N is even. 

9.27. We are given a finite-length sequence x[n] of length 627 (i.e., x[n] = for n < and 
n > 626), and we have available an FFT program that will compute the DFT of a sequence 
of any length N = 2 V , 

For the given sequence, we want to compute samples of the discrete-time Fourier 
transform at frequencies 

lit Ink 

^=627+256' * = <U 255 - 

Specify how to obtain a new sequence y[n] from x[n] such that the desired frequency 
samples can be obtained by applying the available FFT program to y[n] with v as small as 
possible. 

9.28. A finite-length signal of length L = 500 (x[n] = for n < and n > L - 1) is obtained by 
sampling a continuous-time signal with sampling rate 10,000 samples per second. We wish to 
compute samples of the ^-transform of x[n] at the A r equally spaced points zjt = (O.S)^ 2 **^, 
for < k < N — 1, with an effective frequency spacing of 50 Hz or less. 

(a) Determine the minimum value for N if N = 2 V . 

(b) Determine a sequence y[n] of length N, where N is as determined in Part (a), such that 
its DFT Y[k] is equal to the desired samples of the z-transform of x[n]. 

9.29. Suppose that a finite-length sequence x[n] has the Af-point DFT X[k], and suppose that 
the sequence satisfies the symmetry condition 

x[n] = -x[((n + N/2)) N ], < n < N - 1, 

where N is even and x[n] is complex. 

(a) Show that X[k] = for k = 0, 2, . . . , N - 2. 

(b) Show how to compute the odd-indexed DFT values X[k], k — 1,3, . . . , N - 1 using 
only one N/2-point DFT plus a small amount of extra computation. 

9.30. Consider an Appoint sequence x[n] with DFT X[k], k = 0, 1, . . . , N - 1. The following 
algorithm computes the even-indexed DFT values X[k],k = 0,2, ..., N — 2, for N even, 
using only a single Af/2-point DFT: 

1. Form the sequence y[n] by time aliasing, i.e., 

i] +x[n + N/2], < n < N/2 - 1, 



r i /*M 

[n] = \ o 



^ L J ^ n otherwise. 
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2. Compute Y [r], r = 0, 1, . . . , (N/2) - 1, the /V/2-point DFT of y[n], 

3. Then the even-indexed values of X[k] are X[k] = Y [k/2], for k = 0, 2, . . . , TV - 2. 

(a) Show that the preceding algorithm produces the desired results. 

(b) Now suppose that we form a finite-length sequence y[n] from a sequence x[n] by 

{ °° 

I ^ x[n + rM], 0<n<M-l, 
y [n] = t ^> 

I f = — oo 

I 0, otherwise. 

Determine the relationship between the Af-point DFT Y[k] and X(e ]Ui ), the Fourier 
transform of x[n\. Show that the result of Part (a) is a special case of the result of 
Part (b). 

(c) Develop an algorithm similar to the one in Part (a) to compute the odd-indexed DFT 
values X[k], k = 1, 3, . . . , N — 1, for N even, using only a single W/2-point DFT 

9.31. Suppose that an FFT program is available that computes the DFT of a complex sequence. 
If we wish to compute the DFT of a real sequence, we may simply specify the imaginary 
part to be zero and use the program directly. However, the symmetry of the DFT of a real 
sequence can be used to reduce the amount of computation. 

(a) Let x[n] be a real-valued sequence of length N, and let A' [A:] be its DFT with real and 
imaginary parts denoted X R [k] and Xj[k], respectively; i.e., 

X[k] = X R [k] + jX I [k}. 

Show that if x[n] is real, then X R [k] = X R [N - k] and Xi[k\ = -Xi[N - k] for 
k=l,...,N-l. 

(b) Now consider two real- valued sequences x\[n] and X2[n] with DFTs X\[k] and X 2 [k] y 
respectively. Let g[n] be the complex sequence g[n] = x\ [n] + jx2[n], with correspond- 
ing DFT G[k] = G R [k] + jG^k]. Also, let G rM, G er [A:], G \[k] and G E i[fe] denote, 
respectively, the odd part of the real part, the even part of the real part, the odd part of 
the imaginary part, and the even part of the imaginary part of G[k], as denned through 
Eqs. (8.102). Specifically, forl<k<N-l, 

Gor[*] = l{G R [k]-G R [N-k]l 

G ER [k] = ±{G R [k] + G R [N - k]l 

G i[k] = \[G I [k]-G,[N-k]) t 

G El [k] = \{Gj[k] + Gj[N-k]}, 

and G OR [0] = G O i[0] = 0, G E r[0] = G R [0], G E i[0] = G 7 [0]. Determine expressions 
for X x [k] and X 2 [k] in terms of G OR [A:], G ER [k], G i[k], and G E i[k]. 

(c) Assume that N — 2 V and that a radix-2 FFT program is available to compute the DFT. 
Determine the number of real multiplications and the number of real additions required 
to compute both X\[k\ and Xi[k\ by (i) using the program twice (with the imaginary 
part of the input set to zero) to compute the two complex TV-point DFTs X\ [k] and 
X 2 [k] separately and (ii) using the scheme suggested in Part (b), which requires only 
one Appoint DFT to be computed. 

(d) Assume that we have only one real TV-point sequence x[n], where TV is a power of 2. Let 
x\[n] andjt2[n] be the two real 7V/2-point sequences jq [n] = x[2n] and^fn] = jc[2n+l], 
wheren = 0, 1, . . . , (W/2)-l. Determine X [k] in terms of the (Af/2)-pointDFTs Xi[k] 
andX 2 [k]. 

(e) Using the results of Parts (b), (c), and (d), describe a procedure for computing the 
DFT of the real TV-point sequence x[n] utilizing only one 7V/2-point FFT computation. 
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Determine the numbers of real multiplications and real additions required by this pro- 
cedure, and compare these numbers with the numbers required if the X[k] is computed 
using one N-point FFT computation with the imaginary part set to zero. 

9.32. Let x[n] and h[n] be two real finite-length sequences such that 

x[n] — for n outside the interval < n < L — 1, 
h[n] = for n outside the interval < n < P — 1. 

We wish to compute the sequence y[n] = x[n]*h[n], where * denotes ordinary convolution. 

(a) What is the length of the sequence y[n]l 

(b) For direct evaluation of the convolution sum, how many real multiplications are re- 
quired to compute all of the nonzero samples of y[ri\7 The following identity may be 
useful: 

(c) State a procedure for using the DFT to compute all of the nonzero samples of y[ri\. 
Determine the minimum size of the DFTs and inverse DFTs in terms of L and P. 

(d) Assume that L— P = 7V/2, where N = 2 V is the size of the DFT. Determine a formula 
for the number of real multiplications required to compute all the nonzero values of y[n] 
using the method of Part (c) if the DFTs are computed using a radix-2 FFT algorithm. 
Use this formula to determine the minimum value of N for which the FFT method 
requires fewer real multiplications than the direct evaluation of the convolution sum. 

9.33. In Section 8.7.3, we showed that linear time-invariant filtering can be implemented by sec- 
tioning the input signal into finite-length segments and using the DFT to implement circular 
convolutions on these segments. The two methods discussed were called the overlap-add 
and the overlap-save methods. If the DFTs are computed using an FFT algorithm, these 
sectioning methods can require fewer complex multiplications per output sample than the 
direct evaluation of the convolution sum. 

(a) Assume that the complex input sequence x[n] is of infinite duration and that the com- 
plex impulse response h[n] is of length P samples, so that h[n] ^OonlyforO < n < P— 1. 
Also, assume that the output is computed using the overlap-save method, with the 
DFTs of length L = 2 V , and suppose that these DFTs are computed using a radix-2 
FFT algorithm. Determine an expression for the number of complex multiplications 
required per output sample as a function of v and P. 

(b) Suppose that the length of the impulse response is P = 500. By evaluating the formula 
obtained in Part (a), plot the number of multiplications per output sample as a function 
of v for the values of v < 20 such that the overlap-save method applies. For what 
value of v is the number of multiplications minimal? Compare the number of complex 
multiplications per output sample for the overlap-save method using the FFT with the 
number of complex multiplications per output sample required for direct evaluation 
of the convolution sum. 

(c) Show that for large FFT lengths, the number of complex multiplications per output 
sample is approximately v. Thus, beyond a certain FFT length, the overlap-save method 
is less efficient than the direct method. If P = 500, for what value of v will the direct 
method be more efficient? 

(d) Assume that the FFT length is twice the length of the impulse response (i.e., L = 2P), 
and assume that L = 2 V . Using the formula obtained in Part (a), determine the smallest 
value of P such that the overlap-save method using the FFT requires fewer complex 
multiplications than the direct convolution method. 
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9.34. x[n] is a 1024-point sequence that is nonzero only f or < n < 1023, Let X[k] be the 
1024-point DFT of x[n]. Given X[k], we want to compute x[n] in the ranges < n < 3 and 
1020 < n < 1023 using the system in Figure P9.34-1. Note that the input to the system is the 
sequence of DFT coefficients. By selecting mi[&], /»2W» and h[k], show how the system can 
be used to compute the desired samples of x[n]. Note that the samples y[n] for < n < 7 
must contain the desired samples of x[n]. 



x[n] 



■0 



h[n] 



y[n] 



m M\ 



m 2 [n] 



Figure P9.34-1 



9.35. Consider a class of DFT-based algorithms for implementing a causal FIR filter with impulse 
response h[n] that is zero outside the interval < n < 63. The input signal (for the FIR 
filter) x[n] is segmented into an infinite number of possibly overlapping 128-point blocks 
Xi[n], for / an integer and — oo < * < oo, such that 



Xi[n] = 



x[n], iL < n < iL-\- 121, 
0, otherwise, 



where L is a positive integer. 

Specify a method for computing 

yi[n] = x, [n]*h[n] 

for any i . Your answer should be in the form of a block diagram utilizing only the types of 
modules shown in Figures P9.35-1 and P9.35-2. A module may be used more than once or 
not at all. 

The four modules in Figure P9.35-2 either use radix-2 FFTs to compute X[k], the 
N-point DFT of x[n], or use radix-2 inverse FFTs to compute x[n] from X[k\. 

Your specification must include the lengths of the FFTs and IFFTs used. For each 
"shift by «o" module, you should also specify a value for no, the amount by which the input 
sequence is to be shifted. 



















Multiply 










Shift 

by« 


x { [n] 




x[n] 




x[n 


-«o] 


*i["]j 


Finu 




















x 2 [n] 






Figure P9.35-1 








FFT-1 

(iV-point) 


where J P[A:]is^[A:]in 
bit-reversed order. 

where q [n] is x [n] in 
bit-reversed order. 

where r[n] isjc[«] in 
bit-reversed order. 

where S[k] is X[k] in 
bit-reversed order. 
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X[n] 




r[k] 
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x[k] 


re P9.35-2 
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Extension Problems 

9.36. In many applications (such as evaluating frequency responses and interpolation), it is of 
interest to compute the DFT of a short sequence that is "zero-padded." In such cases, a 
specialized "pruned" FFT algorithm can be used to increase the efficiency of computation 
(Markel, 1971). In this problem, we will consider pruning of the radix-2 decimation-in- 
frequency algorithm when the length of the input sequence is M < 2^ and the length of the 
DFT is N = 2 V , where (i < v. 

(a) Draw the complete flow graph of a decimation-in-frequency radix-2 FFT algorithm for 
N = 16. Label all branches appropriately. 

(b) Assume that the input sequence is of length M = 2; i.e., x[n] ^ only for N = and 
N = 1. Draw a new flow graph for N = 16 that shows how the nonzero input samples 
propagate to the output DFT; i.e., eliminate or prune all branches in the flow graph of 
Part (a) that represent operations on zero-inputs. 

(c) In Part (b), all of the butterflies in the first three stages of computation should have been 
effectively replaced by a half-butterfly of the form shown in Figure P9.36-1, and in the 
last stage, all the butterflies should have been of the regular form. For the general case 
where the length of the input sequence is M < 2 M and the length of the DFT is N = 2 V , 
where (i < v, determine the number of stages in which the pruned butterflies can be 
used. Also, determine the number of complex multiplications required to compute the 
Appoint DFT of an Af-point sequence using the pruned FFT algorithm. Express your 
answers in terms of v and (x. 



°x m \p\ 




ox m [q] Figure P9.36-1 

9.37. In Section 9.3, we showed that if N is divisible by 2, an Appoint DFT may be expressed as 

X[k] = G[k] + W$[k]H[kl 0<k<N-l, (P9.37-1) 

where G[k] is the iV/2-point DFT of the sequence of even-indexed samples, 

g[n] = x[2n], < n < (N/2) - 1, 

and H[k] is the JV/2-point DFT of the odd-indexed samples, 

h[n] = x[2n + 1], < n < (N/2) - 1. 

When N = 2 V , repeated application of this decomposition leads to the decimation-in-time 
FFT algorithm depicted for N = 8 in Figure 9.10. As we have seen, such algorithms require 
complex multiplications by the "twiddle" factors WjJ. Rader and Brenner (1976) derived a 
new algorithm in which the multipliers are purely imaginary, thus requiring only two real 
multiplications and no real additions. In this algorithm, Eq. (P9.37-1) is replaced by the 
equations 

X[0] = G[0] + F[0], (P9.37-2a) 

X[N/2] = G[0] - F[0], (P9.37-2b) 

1 F\k\ 

X[k] = G[k] - - / _-U_ k ^ 0, N/2. (P9.37-2c) 

2 §\n(2nk/N) 
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Here, F [k] is the A r /2-point DFT of the sequence 

f[n] = x[2n + 1] - x[2n - 1] + Q, 
where 

(N/2)-l 

Q=n E x ^ + i] 

is a quantity that need be computed only once. 

(a) Show that F[0] = H[0] and therefore that Eqs. (P9.37-2a) and (P9.37-2b) give the 
same result as Eq. (P9.37-1) for k = 0, N/2. 

(b) Show that 

F[k] = H[k]W k (W^ k -W k ) 

for k = 1,2,..., (tf/2) - 1. Use this result to obtain Eq. (P9.37-2c). Why must we 
compute X [0] and X[N/2] using separate equations? 

(c) When N = 2 V , we can apply Eqs. (P9.37-2a)-(P9.37-2c) repeatedly to obtain a com- 
plete decimation-in-time FFT algorithm. Determine formulas for the number of real 
multiplications and for the number of real additions as a function of N. In counting 
operations due to Eq. (P9.37-2c), take advantage of any symmetries and periodicities, 
but do not exclude "trivial" multiplications by ±j/2. 

(d) Rader and Brenner (1976) state that FFT algorithms based on Eqs. (P9.37-2a)- 
(P9.37-2c) have "poor noise properties." Explain why this might be true. 

9.38. A modified FFT algorithm called the split-radix FFT, or SRFFT, was proposed by Duhamel 
and Hollman (1984) and Duhamel (1986). The flow graph for the split-radix algorithm is 
similar to the radix-2 flow graph, but it requires fewer real multiplications. In this problem, 
we illustrate the principles of the SRFFT for computing the DFT X[k] of a sequence x[n] 
of length N. 

(a) Show that the even-indexed terms of X[k] can be expressed as the A^/2-point DFT 

(N/2)-l 

X[2k]= J2 (x[n] + x[n + N/2])W* kn 

for* = 0,l,...,(A72)-l. 

(b) Show that the odd-indexed terms of the DFT X[k] can be expressed as the jV/4-point 
DFTs 

X[4k+1] 

{N/4)-l 

= Yl {(*["] ~ *[" + N/2]) -j(x[n + N/4]- x[n + 3N/4])}W£W* kn 

n=0 

for k = 0,1,..., (N/4) -1, and 
X[4k + 3] 

(JV/4)-l 

= Yl {( X W- *W + N/2]) + j{x[n + N/4]- x[n + 3N/4])}Wfj l W$ J kn 

for k = 0,1 {N/4) -I. 

(c) The flow graph in Figure P9.38-1 represents the preceding decomposition of the DFT for 
a 16-point transform. Redraw this flow graph, labeling each branch with the appropriate 
multiplier coefficient. 
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oA^lO] 




Figure P9.38-1 



(d) Determine the number of real multiplications required to implement the 16-point 
transform when the SRFFT principle is applied to compute the other DFTs in Fig- 
ure P9.38-1. Compare this number with the number of real multiplications required to 
implement a 16-point radix-2 decimation-in-frequency algorithm. In both cases, assume 
that multiplications by WjJ are not done. 

9.39. In computing the DFT, it is necessary to multiply a complex number by another complex 
number whose magnitude is unity, i.e., (X+ \Y)e iB '. Clearly, such a complex multiplication 
changes only the angle of the complex number, leaving the magnitude unchanged. For 
this reason, multiplications by a complex number e }0 are sometimes called rotations. In 
DFT or FFT algorithms, many different angles may be needed. However, it may be 
undesirable to store a table of all required values of sin 9 and cos0, and computing these 
functions by a power series requires many multiplications and additions. With the CORDIC 
algorithm given by Voider (1959), the product (X+ jY)ei 9 can be evaluated efficiently by 
a combination of additions, binary shifts, and table lookups from a small table. 
(a) Define #,- = arctan(2~'). Show that any angle < < jt/2 can be represented as 

M-l 



= ^ai6i +e =6 + €, 



i'=0 



where or, = ±1 and the error e is bounded by 

k| < arctan(2 _M ). 
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(b) The angles <9, may be computed in advance and stored in a small table of length M. 
State an algorithm for obtaining the sequence {a,} for / — 0, 1, . . . , M — 1, such that 
of; = ±1. Use your algorithm to determine the sequence {a-; ) for representing the angle 
= IOOjt/512 when M = 11. 

(c) Using the result of Part (a), show that the recursion 

X Q = X, 
Y = Y, 

Xi = X;-x -a,-_ 1 Yi-_ 1 2- , ' +1 , / =1,2 M, 

Yi = y;-_i+a,-_iA r 1 -_i2- , ' +1 , i = 1,2, . . . , M, 

will produce the complex number 

(X M + jY M ) = (X+jY)G M e>*, 

where 9 = J^JJ ^'^ anc * ^ M * s rea ^ * s Positive, and does not depend on d. That is, the 
original complex number is rotated in the complex plane by an angle § and magnified 
by the constant Gm- 

(d) Determine the magnification constant Gm as a function of M. 

9.40. In Section 9.4, we developed the decimation-in-frequency FFT algorithm for radix 2, i.e., 
N = 2 V . It is possible to formulate a similar algorithm for the general case of N = m v , where 
m is an integer. Such an algorithm is known as a radix -m FFT algorithm. In this problem, 
we will examine the radix-3 decimation-in-frequency FFT for the case when N = 9, i.e., 
the input sequence x[n] — for n < and n > 8. 

(a) Formulate a method of computing the DFT samples ^[3/:] for k = 0, 1, 2. Consider 
denning X\[k] = X(e f0)k )\ (0k= 2 7T k/3- How can you define a time sequence xi[n] in terms 
of x[n] such that the 3-point DFT of xi[n] is X\[k] = X[3k]? 

(b) Now define a sequence jqD?] in terms of x[n] such that the 3-point DFT of xi[n\ is 
X 2 [k] - X[3k + 1] for k = 0, 1, 2. Similarly, define x 3 [n] such that its 3-point DFT 
X 3 [k] = X[3k + 2] for k = 0, 1, 2. Note that we have now denned the 9-point DFT as 
three 3-point DFTs from appropriately constructed 3-point sequences. 

(c) Draw the signal flow graph for the N = 3 DFT, i.e., the radix-3 butterfly. 

(d) Using the results for Parts (a) and (b), sketch the signal flow graph for the system that 
constructs the sequences x\[n], X2[n], and x 3 [n], and then use 3-point DFT boxes on 
these sequences to produce X[k] for k = 0, . . . , 8. Note that in the interest of clarity, 
you should not draw the signal flow graph for the N — 3 DFTs, but simply use boxes 
labeled " N = 3 DFT." The interior of these boxes is the system you drew for Part (c). 

(e) Appropriate factoring of the powers of Wg in the system you drew in Part (d) allows 
these systems to be drawn as JV = 3 DFTs, followed by "twiddle" factors analogous 
to those in the radix-2 algorithm. Redraw the system in Part (d) such that it consists 
entirely of N = 3 DFTs with "twiddle" factors. This is the complete formulation of the 
radix-3 decimation-in-frequency FFT for N =9. 

(f) How many complex multiplications are required to compute a 9-point DFT using 
a direct implementation of the DFT equation? Contrast this with the number of com- 
plex multiplications required by the system you drew in Part (e). In general, how 
many complex multiplications are required for the radix-3 FFT of a sequence of length 
N = 3 V 7 

9.41. Bluestein (1970) showed that if N = M 2 , then the chirp transform algorithm has a recursive 
implementation. 
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(a) Show that the DFT can be expressed as the convolution 

N-l 

X[k] = h*[k] ^2(x[n]h*[n])h[k - n], 



n=0 



where * denotes complex conjugation and 

h[n] = e^ /N)n \ 



—oo < n < oo. 



(b) Show that the desired values of X[k] (i.e., for k = 0, 1, . . . , N— 1) can also be obtained 
by evaluating the convolution of Part (a) for k — N, N + 1 , . . . , 2N — 1. 

(c) Use the result of Part (b) to show that X[k] is also equal to the output of the system 
shown in Figure P9 .41-1 for k = N, N + 1 , . . . , 2 N — 1 , where h [k] is the finite-duration 
sequence 

e j(x/N)k*^ o<k<2N-l, 



h[k] = 



0, 



otherwise. 



(d) Using the fact that N = M 2 1 show that the system function corresponding to the impulse 
response h[k] is 

2N-1 

H{ Z ) = J2 e^ tN)kl z~ k 

M-l 



= £ 



J(7T/N)r 2 .-r 



\-z 



-2M 1 



r=0 



\ + e j{2n/M)r z -M 



Hint: Express k as k = r + IM. 

(e) The expression for H(z) obtained in Part (d) suggests a recursive realization of the FIR 
system. Draw the flow graph of such an implementation. 

(f) Use the result of Part (e) to determine the total numbers of complex multiplications 
and additions required to compute all of the N desired values of X[k]. Compare those 
numbers with the numbers required for direct computation of X[k]. 




h*[k] 



h*[k] 



Figure P9.41-1 

9,42. In the Goertzel algorithm for computation of the discrete Fourier transform, X[k] is com- 
puted as 

X[k] = y k [Nl 

where yk[n] is the output of the network shown in Figure P9.42-1. Consider the implemen- 
tation of the Goertzel algorithm using fixed-point arithmetic with rounding. Assume that 




Figure P9.42-1 
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the register length is B bits plus the sign, and assume that the products are rounded before 
additions. Also, assume that round-off noise sources are independent. 

(a) Assuming that x[n] is real, draw a flow graph of the linear-noise model for the finite- 
precision computation of the real and imaginary parts of X[k\. Assume that multipli- 
cation by ±1 produces no round-off noise. 

(b) Compute the variance of the round-off noise in both the real part and the imaginary 
part of X[k]. 

9.43. Consider direct computation of the DFT using fixed-point arithmetic with rounding. As- 
sume that the register length is B bits plus the sign (i.e., a total of B + 1 bits) and that 
the round-off noise introduced by any real multiplication is independent of that produced 
by any other real multiplication. Assuming that x[n] is real, determine the variance of the 
round-off noise in both the real part and the imaginary part of each DFT value X[k]. 

9.44. In implementing a decimation-in-time FFT algorithm, the basic butterfly computation is 

X m [p] = X m ^[p] + W r N X m -ilq], 

X m lq]^X m . l [p]-Wf / X m .i[q]. 

In using fixed-point arithmetic to implement the computations, it is commonly assumed 
that all numbers are scaled to be less than unity. Therefore, to avoid overflow, it is necessary 
to ensure that the real numbers that result from the butterfly computations do not exceed 
unity. 

(a) Show that if we require 

\Xm-i[p]\ < i and \X m ^[q]\ < ±, 
then overflow cannot occur in the butterfly computation; i.e., 

\Ke{X m [p]}\ < I, \Jm[X m [p]}\ < 1, 
and 

\Ke{X m [q]}\ < 1, \Jm[X m [q]}\ < 1. 

(b) In practice, it is easier and most convenient to require 

\Ke{X m -i[p]}\ < h \Jrn{X m -x[p\}\ < \, 
and 

\Tle{X m ^[q]}\ < I, \Jm{X m ^[q]}\ < \. 

Are these conditions sufficient to guarantee that overflow cannot occur in the 
decimation-in-time butterfly computation? Explain. 

9.45. In deriving formulas for the noise-to-signal ratio for the fixed-point radix-2 decimation-in- 
time FFT algorithm, we assumed that each output node was connected to (N — 1) butterfly 
computations, each of which contributed an amount o\ = \ • 2~ 2B to the output noise 
variance. However, when V/ r N = ±1 or ±j, the multiplications can in fact be done without 
error. Thus, if the results derived in Section 9.7 are modified to account for this fact, we 
obtain a less pessimistic estimate of quantization noise effects. 

(a) For the decimation-in-time algorithm discussed in Section 9.7, determine, for each 
stage, the number of butterflies that involve multiplication by either ±1 or ±j. 

(b) Use the result of Part (a) to find improved estimates of the output noise variance, 
Eq. (9.55), and noise-to-signal ratio, Eq. (9.65), for odd values of k. Discuss how these 
estimates are different for even values of k. Do not attempt to find a closed form 
expression of these quantities for even values of k. 

(c) Repeat Parts (a) and (b) for the case where the output of each stage is attenuated 
by a factor of \\ i.e., derive modified expressions corresponding to Eq. (9.68) for the 
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output noise variance and Eq. (9.69) for the output noise-to-signal ratio, assuming that 
multiplications by ±1 and ±j do not introduce error. 

9.46. In Section 9.7 we considered a noise analysis of the decimation-in-time FFT algorithm 
of Figure 9.10. Carry out a similar analysis for the decimation-in-frequency algorithm of 
Figure 9.20, obtaining equations for the output noise variance and noise-to-signal ratio for 
scaling at the input and also for scaling by \ at each stage of computation. 

9.47. In this problem, we consider a procedure for computing the DFT of four real symmetric 
or antisymmetric TV-point sequences using only one TV-point DFT computation. Since we 
are considering only finite-length sequences, by symmetric and antisymmetric, we explicitly 
mean periodic symmetric and periodic antisymmetric, as defined in Section 8.6.4. Let x\ [n], 
X2[n], x 3 [n], and x 4 [n] denote the four real sequences of length TV, and let A^/c], ^[/c], 
Aj[fc], and X 4 [k] denote the corresponding DFTs. We assume first that X] [n] and jq[>i] are 
symmetric and x 3 [n] and X4[n] are antisymmetric; i.e., 

X][n] = X[[N — n], X2[n] = X2[N — n], 

x 3 [n] = -x 3 [N - n], x 4 [n] = -x 4 [N - n], 

for n - 1, 2, . . . , TV - 1 and x 3 [0] = jc 4 [0] = 0. 

(a) Define y\[n] = X][n] 4- x 3 [n] and let Y\[k] denote the DFT of y\[n]. Determine how 
X\ [k] and Xi[k\ can be recovered from Y\[k\. 

(b) vi [n] as defined in Part (a) is a real sequence with symmetric part *i [n] and antisym- 
metric part JC3[n]. Similarly, we define the real sequence y2[ri\ = X2[n\ 4- x 4 [n], and we 
let y 3 [n] be the complex sequence 

yAn] =yiM + /v 2 [n]. 

First determine how yi [k] and Y2[k] can be determined from Y 3 [k], and then, using the 
results of Part (a), show how to obtain ATi[fc], A^f/:], Ajffc], and X 4 [k] from Y 3 [k], 

The result of Part (b) shows that we can compute the DFT of four real sequences 
simultaneously with only one TV-point DFT computation if two sequences are sym- 
metric and the other two are antisymmetric. Now consider the case when all four are 
symmetric; i.e., 

Xi [n] = Xj[N-n], / = 1,2,3,4, 

forn = 0,l,...,TV-l. 

(c) Consider a real symmetric sequence x 3 [n\. Show that the sequence 

£i 3 [n] = x 3 [((n 4- 1))n] - x 3 [((n - 1))n] 

is an antisymmetric sequence; i.e., 1/3 [n] = —1/3 [TV — n] for n = 1, 2, . . . , TV — 1 and 
ii 3 [0] = 0. 

(d) Let U 3 [k] denote the TV-point DFT of 1/3 [n] . Determine an expression for U 3 [k] in terms 
ofX 2 [k]. 

(e) By using the procedure of Part (c), we can form the real sequence vi [n] = xi [n] + u 3 [n], 
where jci [n] is the symmetric part and 1/3 [n] is the antisymmetric part of vi [«]. Determine 
how X\[k\ and X 3 [k] can be recovered from Y\[k\. 

(f) Now let y 3 [n] = y\[n] 4- /j^M, where 

v 1 [n] = x\ [n] 4- u 3 [n] , y 2 [«] = x 2 [n] 4- u 4 [n] , 
with 

u 3 [n] = x 3 [((n 4- 1))*] - x 3 [((n - 1)) N ], 
u 4 [n] = x 4 [((n 4- 1))*] - x 4 [((n - l)) N ], 
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for n = 0, 1, . . . , N - 1. Determine how to obtain Ai[fc], A^M, Aj[fc], and X^k] from 
Ys[k]. (Note that Ajjp] and Xa[0] cannot be recovered from Y?\k\, and if N is even, 
X$[N/2] and Xj[jV/2] also cannot be recovered from V^fc].) 

9.48. The input and output of a linear time-invariant system satisfy a difference equation of the 
form 

TV M 

y[n\ = ^2 ° ky ^ n ~ k ] + X/ bkX ^ n ~ k ^' 

k=\ t=o 

Assume that an FFT program is available for computing the DFT of any finite-length 
sequence of length N = 2 V . Describe a procedure that utilizes the available FFT program 
to compute 

H ( e j<2n/S\2)k) for * = 0, 1, . . . , 511, 

where H(z) is the system function of the system. 

9.49. Suppose that we wish to multiply two very large numbers (possibly thousands of bits long) 
on a 16-bit computer. In this problem, we will investigate a technique for doing this using 
FFTs. 

(a) Let p(x) and q{x) be the two polynomials 

L-l M-l 

Show that the coefficients of the polynomial r(x) = p(x)q(x) can be computed using 
circular convolution. 

(b) Show how to compute the coefficients of r(x) using a radix-2 FFT program. For what 
orders of magnitude of (L + M) is this procedure more efficient than direct computa- 
tion? Assume that L + M = 2 V for some integer v. 

(c) Now suppose that we wish to compute the product of two very long positive binary 
integers u and v. Show that their product can be computed using polynomial multipli- 
cation, and describe an algorithm for computing the product using an FFT algorithm. If 
u is an 8000-bit number and i; is a 1000-bit number, approximately how many real mul- 
tiplications and additions are required to compute the product u ■ v using this method? 

(d) Give a qualitative discussion of the effect of finite-precision arithmetic in implementing 
the algorithm of Part (c). 

9.50. The discrete Hartley transform (DHT) of a sequence x[n] of length N is defined as 

JV— 1 

X H [k] = ^T x[n]H N [nk], k = 0, 1, . . . , N - 1, 

n=0 

where 

H N [a] = C N [a] + S N [a], 
with 

Cn[o] = cos(2jta/N), Sn[o] — sm{2na/N). 

Problem 8.65 explores the properties of the discrete Hartley transform in detail, particularly 

its circular convolution property. 

(a) Verify that H^[a] = H^[a + jV], and verify the following useful property of Hn[o\\ 

H N [a + b] = H N [a]C N [b] + H N [-a]S N [b] 
= H N [b]C N [a] + H N [-b]S N [a], 



690 



Computation of the Discrete Fourier Transform Chap. 9 



(b) By decomposing x[n] into its even-numbered points and odd-numbered points, and 
by using the identity derived in Part (a), derive a fast DHT algorithm based on the 
decimation-in-time principle. 

9.51. In this problem, we will write the FFT as a sequence of matrix operations. Consider the 
8-point decimation-in-time FFT algorithm shown in Figure P9.51-1. Let a and f denote the 
input and output vectors, respectively. Assume that the input is in bit-reversed order and 
that the output is in normal order (compare with Figure 9.10). Let b, c, d, and e denote the 
intermediate vectors shown on the flow graph. 
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(a) Determine the matrices Fi , Ti , F2, T2, and F3 such that 

b = Fia, 
c = Tib, 
d = F 2 c, 
e = T 2 d, 
f = F 3 e 

(b) The overall FFT, taking input a and yielding output f can be described in matrix notation 
as f = Qa, where 

Q = F3T2F2T1F1. 

Let Q H be the complex (Hermitian) transpose of the matrix Q. Draw the flow graph 
for the sequence of operations described by Q^. What does this structure compute? 

(c) Determine (1/N)Q H Q. 

9.52. In many applications, there is a need to convolve long sequences x [n] and h[n] whose samples 
are integers. Since the sequences have integer coefficients, the result of the convolution 
y[n] — x[n] * h[n] will naturally also have integer coefficients as well. 

A major drawback of computing the convolution of integer sequences with FFTs is 
that floating-point arithmetic chips are more expensive than integer arithmetic chips. Also, 
rounding noise introduced during a floating-point computation may corrupt the result. In 
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this problem, we consider a class of FFT algorithms known as number-theoretic transforms 
(NTTs), which overcome these drawbacks. 

(a) Let x[n] and h[n] be N-point sequences and denote their DFTs by X[k] and H[k], 
respectively. Derive the circular convolution property of the DFT. Specifically, show 
that Y[k] = X[k]H[k], where y[n] is the TV-point circular convolution of x[n] and h[n]. 
Show that the circular convolution property holds as long as Wn in the DFT satisfies 

!>**={? IK < P9 - 52 - 1 ) 

The key to denning NTTs is to find an integer-valued WV that satisfies Eq. (P9.52-1). 
This will enforce the orthogonality of the basis vectors required for the DFT to function 
properly. Unfortunately, no integer-valued H^v exists that has this property for standard 
integer arithmetic. 

In order to overcome this problem, NTTs use integer arithmetic defined modulo 
some integer P. Throughout the current problem, we will assume that P = 17. That is, 
addition and multiplication are defined as standard integer addition and multiplication, 
followed by modulo P = 17 reduction. For example, ((23 + 18))i 7 = 7, ((10-f 7)) 17 = 0, 
((23 x 18))i7 = 6, and ((10 x 7))n = 2. (Just compute the sum or product in the normal 
way, and then take the remainder modulo 17.) 

(b) Let P = 17, N = 4, and W N = 4. Verify that 

(c) Let x[n] and h[n] be the sequences 

x[n] = S[n] + 28[n - 1] + 38[n - 2], 
h[n] = 38[n] + 8[n - 1]. 

Compute the 4-point NTT X[k] of x[n] as follows: 

Compute H[k] in a similar fashion. Also, compute Y[k] = H[k]X[k]. Assume the 
values of P, jV, and W)v given in Part (a). Be sure to use modulo 17 arithmetic for each 
operation throughout the computation, not just for the final result/ 

(d) The inverse NTT of Y[k] is denned by the equation 

y[n] = ( ( (N)- 1 £ Y[k]W^ k \ J . (P9.52-2) 

In order to compute this quantity properly, we must determine the integers (1/7V) -1 
and W^ 1 such that 

((<">-'")), = 1 - 
((WnWj 1 )) p = 1. 

Use the values of P, N, and Wh given in Part (a), and determine the aforesaid integers. 

(e) Compute the inverse NTT shown in Eq. (P9.52-2) using the values of (N)~ l and W^ 1 
determined in Part (d). Check your result by manually computing the convolution 
y[n] = x[n] * h[n]. 
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9.53. Sections 9.3 and 9.4 focus on the fast Fourier transform for sequences where N is a power 
of 2. However, it is also possible to find efficient algorithms to compute the DFT when 
the length N has more than one prime factor, i.e., cannot be expressed as N = m v for 
some integer m. In this problem, you will examine the case where N = 6. The techniques 
described extend easily to other composite numbers. Burrus and Parks (1985) discuss such 
algorithms in more detail. 

(a) The key to decomposing the FFT for N = 6 is to use the concept of an index map, 
proposed by Cooley and Tukey (1965) in their original paper on the FFT. Specifically, 
for the case of N = 6, we will represent the indices n and k as 

n = 3n l +n 2 for«i = 0, l;n 2 =0, 1,2; (P9.53-1) 

k = k x + 2k 2 for k] = 0, 1; k 2 = 0, 1, 2; (P9.53-2) 

Verify that using each possible value of n\ and n 2 produces each value of n = 0, . . . , 5 
once and only once. Demonstrate that the same holds for k with each choice of k\ 
and k 2 . 

(b) Substitute Eqs. (P9.53-1) and (P9.53-2) into the definition of the DFT to get a new 
expression for the DFT in terms of «i, n 2 , k\, and k 2 . The resulting equation should 
have a double summation over n\ and n 2 instead of a single summation over n. 

(c) Examine the W& terms in your equation carefully. You can rewrite some of these as 
equivalent expressions in W 2 and W3. 

(d) Based on Part (c), group the terms in your DFT such that the n 2 summation is outside 
and the n\ summation is inside. You should be able to write this expression so that 
it can be interpreted as three DFTs with N = 2, followed by some "twiddle" factors 
(powers of Wg), followed by two N = 3 DFTs. 

(e) Draw the signal flow graph implementing your expression from Part (d). How many 
complex multiplications does this require? How does this compare with the number 
of complex multiplications required by a direct implementations of the DFT equation 
for N = 6. 

(f) Find an alternative indexing similar to Eqs. (P9.53-1) and (P9.53-2) that results in a 
signal flow graph that is two N = 3 DFTs followed by three N = 2 DFTs. 
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Fourier analysis of signals 
using the discrete 
fourier transform 



10.0 INTRODUCTION 

In Chapter 8, we developed the discrete Fourier transform (DFT) as a Fourier rep- 
resentation of finite-length signals. Because the DFT can be explicitly computed by 
efficient algorithms discussed in Chapter 9, it plays a central role in a wide variety of 
signal-processing applications, including filtering and spectral analysis. In this chapter, 
we take an introductory look at Fourier analysis of signals using the DFT. 

In applications and algorithms based on explicit evaluation of the Fourier trans- 
form, it is ideally the discrete-time Fourier transform that is desired, while it is the DFT 
that can actually be computed. For finite -length signals, the DFT provides frequency- 
domain samples of the discrete-time Fourier transform, and the implications of this 
sampling must be clearly understood and accounted for. For example, as considered in 
Section 8.7, in linear filtering or convolution implemented by multiplying DFTs rather 
than discrete-time Fourier transforms, a circular convolution is implemented and special 
care must be taken to ensure that the results will be equivalent to a linear convolution. 
In addition, in many filtering and spectral analysis applications, the signals do not inher- 
ently have finite length. As we will discuss, this inconsistency between the finite-length 
requirement of the DFT and the reality of indefinitely long signals can be accommo- 
dated exactly or approximately through the concepts of windowing, block processing, 
and the time-dependent Fourier transform. 
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10.1 FOURIER ANALYSIS OF SIGNALS USING THE DFT 

One of the major applications of the DFT is in analyzing the frequency content of 
continuous-time signals. For example, as we describe in Section 10.5.1, in speech anal- 
ysis and processing, frequency analysis of speech signals is particularly useful in identi- 
fying and modeling the resonances of the vocal cavity. Another example, introduced in 
Section 10.5.2, is Doppler radar systems, in which the velocity of a target is represented 
by the frequency shift between the transmitted and received signals. 

The basic steps in applying the DFT to continuous-time signals are indicated in 
Figure 10.1. The antialiasing filter is incorporated to eliminate or minimize the effect 
of aliasing when the continuous-time signal is converted to a sequence. The need for 
multiplication of x[n] by w[n], i.e., windowing, is a consequence of the finite-length 
requirement of the DFT. In many cases of practical interest, s c (t) and, consequently, 
x[n] are very long or even indefinitely long (such as with speech or music). Therefore, 
a finite-duration window w[n] is applied to x[n] prior to computation of the DFT. Fig- 
ure 10.2 illustrates the Fourier transforms of the signals in Figure 10.1. Figure 10.2(a) 
shows a continuous-time spectrum that tapers off at high frequencies but is not band- 
limited. It also indicates the presence of some narrowband signal energy, represented 
by the narrow peaks. The frequency response of an antialiasing filter is illustrated in 
Figure 10.2(b). As indicated in Figure 10.2(c), the resulting continuous-time Fourier 
transform X c (j £2) contains little useful information about S c (jQ) for frequencies above 
the cutoff frequency of the filter. Since H aa (jQ,) cannot be ideal, the Fourier compo- 
nents of the input in the passband and the transition band also will be modified by the 
frequency response of the filter. 

The conversion of x c (t) to the sequence of samples x[n] is represented in the 
frequency domain by periodic replication and frequency normalization, i.e., 






(10.1) 



as illustrated in Figure 10.2(d). Since, in a practical implementation, the antialiasing 
filter cannot have infinite attenuation in the stopband, some nonzero overlap of the 
terms in Eq. (10.1), i.e., aliasing, can be expected; however, this source of error can be 
made negligibly small either with a high-quality continuous-time filter or through the 
use of initial oversampling followed by more effective lowpass filtering and decimation, 
as discussed in Section 4.8.1. If x[n] is a digital signal, so that A/D conversion is incor- 
porated in the second system in Figure 10.1, then quantization error is also introduced. 
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Figure 10.1 Processing steps in the discrete-time Fourier analysis of a 
continuous-time signal. 
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Figure 10.2 Illustration of the Fourier transforms of the system of Figure 10.1. 
(a) Fourier transform of continuous-time input signal, (b) Frequency response of 
antialiasing filter, (c) Fourier transform of output of antialiasing filter, (d) Fourier 
transform of sampled signal, (e) Fourier transform of window sequence, (f) Fourier 
transform of windowed signal segment and frequency samples obtained using DFT 
samples. 
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As we have seen in Section 4.8.2, this error can be modeled as a noise sequence added 
to x[n]. The noise can be made negligible through the use of fine-grained quantization. 
As indicated, the sequence x[n] is typically multiplied by a finite-duration window 
w[n], since the input to the DFT must be of finite duration. This produces the finite- 
length sequence v[n] = w[n]x[n]. The effect in the frequency domain is a periodic 
convolution, i.e., 

V(e jco ) = — f X(e iB )W(e ji °^ e) )de. (10.2) 

Figure 10.2(e) illustrates the Fourier transform of a typical window sequence. Note that 
the main lobe is assumed to be concentrated around co = 0. If w[n] is constant over the 
range of n for which it is nonzero, it is referred to as a rectangular window. However, as 
we will see, there are good reasons to taper the window at its edges. The properties of 
windows such as the Bartlett, Hamming, Hanning, Blackman, and Kaiser windows are 
discussed in Chapter 7 and in Section 10.2. At this point, it is sufficient to observe that 
convolution of W(e ia> ) with X(e jw ) will tend to smooth sharp peaks and discontinuities 
in X{e^), This is depicted by the continuous curve plotted in Figure 10.2(f). 

The final operation in Figure 10.1 is determining the DFT. The DFT of the win- 
dowed sequence v[n] — w[n]x[n] is 

V[k] = ^2 v[n]e->V x/N)kn , k = 0, 1 N - 1, (10.3) 

where we assume that the window length L is less than or equal to the DFT length N. 
V[k], the DFT of the finite-length sequence v[n], corresponds to equally spaced samples 
of the Fourier transform of v[n\\ i.e., 

V[k] = V(enl =2Kk/N . dO- 4 ) 

Figure 10.2(f) also shows V[k] as the samples of V(e ; ' w ). Since the spacing between 
DFT frequencies is 2tt/N, and the relationship between the normalized discrete-time 
frequency variable and the continuous-time frequency variable is en = QT, the DFT 
frequencies correspond to the continuous-time frequencies 

Qk = jjf- (10.5) 

Many commercial real-time spectrum analyzers are based on the principles em- 
bodied in Figures 10.1 and 10.2. It should be clear from the preceding discussion, how- 
ever, that numerous factors affect the interpretation of the continuous-time Fourier 
transform of the input in terms of the DFT of a windowed segment of the sampled 
signal. To accommodate these factors, care must be taken in filtering and sampling the 
input signal. Furthermore, to interpret the results correctly, the effects of the time- 
domain windowing and of the frequency-domain sampling inherent in the DFT must 
be clearly understood. For the remainder of the discussion, we will assume that the 
issues of antialiasing filtering and continuous-to-discrete-time conversion have been 
satisfactorily handled and are negligible. In the next section we concentrate specifically 
on the effects of windowing and of the frequency-domain sampling imposed by the 
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DFT. We choose sinusoidal signals as the specific class of examples to discuss, but most 
of the issues raised apply more generally. 

Example 10.1 Fourier Analysis Using the DFT 

Consider a bandlimited continous-time signal x c (t) such that X c (j&) = for \Q\ > 
27r(2500). We wish to use the system of Figure 10.1 to estimate the continous-time 
spectrum X c (jQ). Assume that the antialiasing filter H aa (jQ) is ideal and the sampling 
rate for the C/D converter is 1/7 = 5000 samples/sec. If we want the DFT samples 
V[k] to be equivalent to samples of X c (jQ) that are at most 2jt(10) rad/sec or 10 Hz 
apart, what is the minimum value that we should use for the DFT size N? 

From (Eq. 10.5), we see that adjacent samples in the DFT correspond to 
continuous-time frequencies separated by 2ti/(ST). Therefore, we require that 

2tt 

-= < 20jt, 

ST ~ 

which implies that 

N> 500 

satisfies the condition. If we wish to use a radix-2 FFT algorithm to compute the DFT 
in Figure 10.1, we would choose jV = 512 for an equivalent continuous-time frequency 
spacing of AQ = 2tt(5000/512) = 2tt(9.77) rad/sec. 

Example 10.2 Relationship Between DFT Values 

Consider the problem posed in Example 10.1, where 1/ T — 5000, jV = 512, and x c {i) 
is real-valued and is sufficiently bandlimited to avoid aliasing with the given sampling 
rate. If it is determined that V[\ 1] = 2000(1 + }), what can be said about other values 
of V[fc] or about A^/a)? 

Referring to the symmetry properties of the DFT given in Table 8.2, V[k] = 
^*[((-*)) J v], k = 0, 1, . . . , iV - 1 and consequently V[S - k] = V[k], so it follows in 
this case that 

V[512 - 11] = V[501] = V*[U] = 2000(1 - j). 

We also know that the DFT sample k= 11 corresponds to the continuous-time fre- 
quency Q n = 27r(ll)(5000)/512 = 2jt(107.4), and similarly, k = 501 corresponds to 
the frequency -2jt(11)(5000)/512 = -2jt(107.4). Although windowing will smooth 
the spectrum, we can say that 

X c (jan) = X c (/2tt(107.4)) ^ T • V[U] = 0.4(1 + j). 

Note that the factor T is required to compensate for the factor 1/7 introduced by 
sampling, as in Eq. (10.1). We can again exploit symmetry to conclude that 

ATc(-Mi) = * c (-;2;r(107.4)) % T- V[ll] = 0.4(1 - j). 



10.2 DFT ANALYSIS OF SINUSOIDAL SIGNALS 

The discrete -time Fourier transform of a sinusoidal signal Acos(o)on + <f>) is a pair of im- 
pulses at -f-wo and — coo (repeating periodically with period 2n). In analyzing sinusoidal 
signals using the DFT, windowing and spectral sampling have an important effect. As 



698 Fourier Analysis of Signals Using the Discrete Fourier Transform Chap. 1 

we will see in Section 10.2.1, windowing smears or broadens the impulses in the the- 
oretical Fourier representation, and thus, the exact frequency is less sharply defined. 
Windowing also reduces the ability to resolve sinusoidal signals that are closely spaced 
in frequency. The spectral sampling inherent in the DFT has the effect of potentially 
giving a misleading or inaccurate picture of the true spectrum of the sinusoidal signal. 
This effect is discussed in Section 10.2.2. 

10.2.1 The Effect of Windowing 

Let us consider a continuous-time signal consisting of the sum of two sinusoidal com- 
ponents; i.e., 

s c (t) = A Q cos(QQt + 6 Q ) + A\COs(Q\t + 0\), -oo < t < oo. (10.6) 

Assuming ideal sampling with no aliasing and no quantization error, we obtain the 
discrete-time signal 

x[n] = Aocos(coon + 6o) + A\cos(co\n + 6\), — oo < n < oo, (10.7) 

where coq = QoT and co\ = Q\T. The windowed sequence v[n] in Figure 10.1 is tl" 

v[n] = Aow[n]cos(coon + 9q) + A[w[n]cos(coin + 6\). (10.8) 

To obtain the discrete-time Fourier transform of v[n], we can expand Eq. (10.8) in terms 
of complex exponentials and utilize the frequency -shifting property of Eq. (2.163) in 
Section 2.9.2. Specifically, we rewrite v[n] as 

v[n] = ^■w[n]e i9o e i ' OQn + yw[/i]c-' 9 °r^ 

(10-9) 
+ — w[n]e j0] e jCjJ]n + — l -w[n]e~ j0[ e'^^ n , 

from which, with Eq. (2.163), it follows that the Fourier transform of the windowed 
sequence is 

2 A 2 A (1 °- 10) 

According to Eq. (10.10), the Fourier transform of the windowed signal consists of the 
Fourier transform of the window, replicated at the frequencies ±coo and ±co\ and scaled 
by the complex amplitudes of the individual complex exponentials that make up the 
signal. 

Example 10.3 Effect of Windowing on Fourier Analysis of 
Sinusoidal Signals 

We consider the system of Figure 10.1 and, in particular, W(e^ co ) and V(e^ co ) for the 
specific case of a sampling rate 1/7 = 10 kHz and a rectangular window w[n] of 
length 64. The signal amplitude and phase parameters are Aq = 1 and A\ — 0.75 and 
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O = 0\ — 0. To illustrate the essential features, we specifically display only the mag- 
nitudes of the Fourier transforms. 

In Figure 10.3(a) we show \W(ei w )\ and in Figures 10.3(b), (c), (d), and (e) we 
show | V(e ]co )\ for several choices of Qy and Q] in Eq. (10.6) or, equivalently, coq and 
Q)i in Eq. (10.7). In Figure 10.3(b), Q = (2tt/6) x 10 4 and Q } = (2tt/3) x 10 4 , or, 
equivalently, too = 27r/6andaJi = 27r/3. In Figure 10.3 (c)-(e), the frequencies become 
progressively closer. For the parameters in Figure 10.3(b), the frequency and amplitude 
of the individual components are evident. Specifically, Eq. (10.10) suggests that, with 
no overlap between the replicas of W(e^ M ) at a>o and a>\ , there will be a peak of height 
32 A o at (oq and 32 A i at a>\ , since W{e jw ) has a peak height of 64. In Figure 10.3(b), 
the two peaks are at approximately coq = 2tt/6 and co\ = 2tt/3, with peak amplitudes 
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Figure 10.3 Illustration of Fourier analysis of windowed cosines with a rectangu- 
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Figure 10.3 {continued) (c) Q = (2*/14) x lO 4 ,^ = (4;r/15) x 10 4 . 
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(4tt/25) x 10 4 . 
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in the correct ratio. In Figure 10.3(c), there is more overlap between the window 
replicas at ojq and co\, and while two distinct peaks are present, the amplitude of the 
spectrum at oj = ojq is affected by the amplitude of the sinusoidal signal at frequency a>\ 
and vice versa. This interaction is called leakage: The component at one frequency leaks 
into the vicinity of another component due to the spectral smearing introduced by the 
window. Figure 10.3(d) shows the case where the leakage is even greater. Notice how 
side lobes adding out of phase can reduce the heights of the peaks. In Figure 10.3(e), 
the overlap between the spectral windows at ojq and a>\ is so significant that the two 
peaks visible in (b)-(d) have merged into one. In other words, with this window, the 
two frequencies corresponding to Figure 10.3(e) will not be resolved in the spectrum. 

Reduced resolution and leakage are the two primary effects on the spectrum as a 
result of applying a window to the signal. The resolution is influenced primarily by the 
width of the main lobe of W(e^), while the degree of leakage depends on the relative 
amplitude of the main lobe and the side lobes of W(e^°). In Chapter 7. in a filter design 
context, we showed that the width of the main lobe and the relative side -lobe amplitude 
depend primarily on the window length L and the shape (amount of tapering) of the 
window. The rectangular window, which has Fourier transform 

w r (en = y e-i""' = e -M'-n/2 s ' m ^ L / 2 ) (1011) 

^^ sm(a)/2) 

has the narrowest main lobe for a given length, but it has the largest side lobes of all 
the commonly used windows. As defined in Chapter 7, the Kaiser window is 

{ h[P(\ -[(n- a)/a] 2 y< 2 ] 
Mn}=\ /„(/») • U -"- L '' (10.12) 

[ 0, otherwise, 

where a = (L — l)/2 and Iq(-) is the zeroth-order modified Bessel function of the first 
kind. (Note that the notation of Eq. (10.12) differs slightly from that of Eq. (7.59) in 
that L denotes the length of the window in Eq. (10.12) while the length of the filter 
design window in Eq. (7.59) is denoted A/+ 1.) We have already seen in the context of 
the filter design problem that this window has two parameters, /3 and L, which can be 
used to trade between main-lobe width and relative side-lobe amplitude. (Recall that 
the Kaiser window reduces to the rectangular window when /3 = 0.) The main-lobe 
width A m i is defined as the symmetric distance between the central zero-crossings. The 
relative side-lobe level ^4 S ] is defined as the ratio in dB of the amplitude of the main lobe 
to the amplitude of the largest side lobe. Figure 10.4, which is a duplicate of Figure 7.24, 
shows Fourier transforms of Kaiser windows for different lengths and different values 
of /?. In designing a Kaiser window for spectrum analysis, we want to specify a desired 
value of A s \ and determine the required value of /3. Figure 10.4(c) shows that the relative 
side-lobe amplitude is essentially independent of the window length and thus depends 
only on /?. This was confirmed by Kaiser and Schafer (1980), who obtained the following 
least squares approximation to ^ as a function of A s \: 

0, A,i < 13.26, 

£ = { 0.76609(^ s , - 13.26) 04 + 0.09834(,4 s i - 13.26), 13.26 < A sl < 60, (10.13) 
0.12438(/l S ] + 6.3), 60 < A sl < 120. 
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Figure 10.4 (a) Kaiser windows for /? = 0, 3, and 6 and L = 21. (b) Fourier 
transform corresponding to windows in (a), (c) Fourier transforms of Kaiser 
windows with /3 = 6 and L = 1 1 , 21 , and 41 . 
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Using values of /? from Eq. (10.13) gives windows with actual values of A s \ that differ 
by less than 0.36% from the desired value across the range 13.26 < A s \ < 120. (Note 
that the value 13.26 is the relative side-lobe amplitude of the rectangular window, to 
which the Kaiser window reduces for ^ = 0.) 

Figure 10.4(c) also shows that the main-lobe width is inversely proportional to 
the length of the window. The trade-off between main-lobe width, relative side-lobe 
amplitude, and window length is displayed by the approximate relationship 

L*™*±±*> + 1 , (10..4) 

i:oA m | 

which was also given by Kaiser and Schafer (1980). 

Equations (10.12), (10.13), and (10.14) are the necessary equations for determin- 
ing a Kaiser window with desired values of main-lobe width and relative side-lobe 
amplitude. To design a window for prescribed values of A s \ and A rn i requires simply 
the computation of /? from Eq. (10.13), the computation of L from Eq. (10.14), and 
the computation of the window using Eq. (10.12). Many of the remaining examples of 
this chapter use the Kaiser window. Other spectral analysis windows are considered by 
Harris (1978). 



1 0.2.2 The Effect of Spectral Sampling 

As mentioned previously, the DFT of the windowed sequence v[n] provides samples 
of V(e )i0 ) at the N equally spaced discrete-time frequencies w^ — 2nk/N, k = 0, 1, . . . , 
N — 1. These are equivalent to the continuous-time frequencies Q^ = (Ink) /(NT), 
for k = 0. 1, . . . , N/2 (assuming that N is even). The indices k — N/2 + 1, . . . , Af — 1 
correspond to the negative continuous-time frequencies —2tt(N — k)/(NT). Spectral 
sampling, as imposed by the DFT, can sometimes produce misleading results. This effect 
is best illustrated by example. 

Example 1 0.4 Illustration of the Effect 
of Spectral Sampling 

Let us consider the same parameters as in Figure 10.3(c) in Example 10.3, i.e., Aq = 1, 
A Y = 0.75, wo = 2tt/14, coy = 4tt/15, and 0\ = 6 2 = in Eq. (10.8). w[n] is a 
rectangular window of length 64. Then 

«[»]= j COS (li") + °- 75COS (S")- °^ 63 ' (10.15) 

I 0, otherwise. 

Figure 10.5(a) shows the windowed sequence v[n]. Figures 10.5(b), (c), (d), and (e) 
show the corresponding real part, imaginary part, magnitude, and phase, respectively, 
of the DFT of length N — 64. Figure 10.5(f) shows \V{e> w )\, corresponding to Fig- 
ure 10.3(c), but plotted from a> — to u> = 2n for comparison with the DFT in 
Figure 10.5(d). 

In Figures 10.5(b)-(e), the horizontal (frequency) axis is labeled in terms of the 
DFT index or frequency sample number k. The value k — 32 corresponds to oo = tc 
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Figure 10.5 Cosine sequence and discrete Fourier transform with a rectangular 
window, (a) Windowed signal, (b) Real part of DFT. (c) Imaginary part of DFT. 
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or, equivalently, Q = nj T. As is the usual convention in displaying the DFT of a 
time sequence, we display the DFT values in the range from k = 0lok=N— \ y 
corresponding to displaying samples of the discrete-time Fourier transform in the 
frequency range to 2n. Because of the inherent periodicity of the discrete-time 
Fourier transform, the first half of this range corresponds to the positive continuous- 
time frequencies, i.e., Q between zero and izj T, and the second half of the range to the 
negative frequencies, i.e., Q between —nj Tand zero. Note the even periodic symmetry 
of the real part and the magnitude and the odd periodic symmetry of the imaginary 
part and the phase. 

The magnitude of the DFT in Figure 10.5(d) corresponds to samples of the 
magnitude of the spectrum displayed in Figure 10.5(f) and shows the expected con- 
centration around co = 2tz/1.5 and co = 2tt/14, the frequencies of the two sinusoidal 
components of the input. Specifically, the frequency co\ = 4jt/15 = 2jt(8.533 . . .)/64 
lies between the DFT samples corresponding to k = 8 and k = 9. Likewise, the fre- 
quency too = 2jt/14 = 27r(4.5714. . .)/64 lies between the DFT samples corresponding 
to k = 4 and k = 5. Note that the frequency locations of the peaks in Figure 10.5(f) are 
between spectral samples obtained from the DFT. In general, the locations of peaks 
in the DFT values do not necessarily coincide with the exact frequency locations of 
the peaks in the Fourier transform, since the true spectral peaks can lie between spec- 
tral samples. Correspondingly, as evidenced in comparing Figures 10.5(f) and 10.5(d), 
the relative amplitudes of peaks in the DFT will not necessarily reflect the relative 
amplitudes of the true spectral peaks. 



Example 10.5 Spectral Sampling with Frequencies 
Matching DFT Frequencies 

Consider the sequence 

v{n}={ COS (^ n ) +015cOS {T n )' °^ 63 ' (10.16) 

0, otherwise, 

as shown in Figure 10.6(a). Again, a rectangular window is used with N = L — 64. This 
is very similar to the previous example, except that in this case, the frequencies of the 
cosines coincide exactly with two of the DFT frequencies. Specifically, the frequency 
a>[ — 2tz/S = 2jt8/64 corresponds exactly to the DFT sample k = 8 and the frequency 
a>o = 2jt/16 =2jt4/64 to the DFT sample k = 4. 

The magnitude of the 64-point DFT of v[n] for this example is shown in Fig- 
ure 10.6(b) and corresponds to samples of 1 V(e^)\ (which is plotted in Figure 10.6(c)) 
at a frequency spacing of 2jt/64. Although the signal parameters for this example and 
Example 10.4 are very similar, the appearance of the DFT is strikingly different. In 
particular, for this example, the DFT has two strong spectral lines at the frequencies 
of the two sinusoidal components in the signal and no frequency content at the other 
DFT values. In fact, this clean appearance of the DFT in Figure 10.6(b) is largely an 
illusion resulting from the sampling of the spectrum. Comparing Figures 10.6(b) and 
(c), we can see that the reason for the clean appearance of Figure 10.6(b) is that for this 
choice of parameters, the Fourier transform is exactly zero at the frequencies that are 
sampled by the DFT except those corresponding to k = 4, 8, 56, and 60. Although the 
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Figure 10.6 Discrete Fourier analysis of the sum of two sinusoids for a case in 
which the Fourier transform is zero at all DFT frequencies except those correspond- 
ing to the frequencies of the two sinusoidal components, (a) Windowed signal, 
(b) Magnitude of DFT. (c) Magnitude of discrete-time Fourier transform (| V{e' w )\). 
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Figure 10.7 DFTof the signal as in Figure 10.6(a), but with twice the number of 
frequency samples used in Figure 10.6(b). 

signal of Figure 10.6(a) has significant content at almost all frequencies, as evidenced by 
Figure 10.6(c), we do not see this in the DFT because of the sampling of the spectrum. 
Another way of understanding this is to note that, since the signal frequencies are 
all multiples of 27r/64, the signal is periodic with period N = 64. Thus, the 64-point 
rectangular window selects exactly one period, which is what is needed to compute the 
DFS of the periodic signal. (In fact we see from Figure 10.6(a) that v[n] is also periodic 
with period 8.) This is an example of how the inherent assumption of periodicity gives 
a correct answer to a different problem. We are interested in the finite-length case and 
the results are quite misleading. 

To illustrate this point further, we can extend v[n] in Eq. (10.16) by zero-padding 
to obtain a 128-point sequence. The corresponding 128-point DFT is shown in Fig- 
ure 10.7. With this finer sampling of the spectrum, the presence of significant content 
at other frequencies becomes apparent. In this case, the windowed signal is not natu- 
rally periodic with period 128. 



In Figures 10.5, 10.6, and 10.7, the windows were rectangular. In the next set of 
examples, we illustrate the effect of different choices for the window. 



Example 1 0.6 DFT Analysis of Sinusoidal Signals 
Using a Kaiser Window 

Let us return to the frequency, amplitude, and phase parameters of Example 10.3, but 
now with a Kaiser window applied, so that 



v[n] = w K [n]cos [ — n J + 0.75h>k[«]cos f — n ) , 



(10.17) 



where w/^[«] is the Kaiser window as given by Eq. (10.12). We will select the Kaiser 
window parameter fi to be equal to 5.48, which, according to Eq. (10.13), results in a 
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window for which the relative side-lobe amplitude is A s \ = —40 dB. Figure 10.8(a) 
shows the windowed sequence v[n) for a window length of L = 64, and Figure 10.8(b) 
shows the magnitude of the corresponding DFT. From Eq. (10.15), we see that the 
difference between the two frequencies is a>\ — coo — 2jt/7.5 — 2tt/14 = 0.389. From 
Eq. (10.14), it follows that the width of the main lobe of the Fourier transform of the 
Kaiser window with L — 64 and fi = 5.48 is A m i = 0.401. Thus, the main lobes of the 
two replicas of W^(e ; ' w ) centered at coq and co\ will just slightly overlap in the frequency 
interval between the two frequencies. This is evident in Figure 10.8(b), where we see 
that the two frequency components are clearly resolved. 

Figure 10.8(c) shows the same signal, multiplied by a Kaiser window with L = 32 
and fi = 5.48. Since the window is half as long, we expect the width of the main lobe 
of the Fourier transform of the window to double, and Figure 10.8(d) confirms this. 
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Figure 10.8 Discrete Fourier analysis with Kaiser window, (a) Windowed 
sequence for L = 64. (b) Magnitude of DFT for L = 64. 
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Figure 10.8 (continued) (c) Windowed sequence for L = 32. (d) Magnitude of 
DFT for/. = 32. 



Specifically, Eqs. (10.13) and (10.14) confirm that for L = 32 and = 5.48, the main- 
lobe width is A m i = 0.815. Now the main lobes of the two copies of the Fourier 
transform of the window overlap throughout the region between the two cosine fre- 
quencies, and we do not see two distinct peaks. 



In all the previous examples except in Figure 10.7, the DFT length N was equal 
to the window length L. In Figure 10.7, zero-padding was applied to the windowed 
sequence before computing the DFT to obtain the Fourier transform on a more finely 
divided set of frequencies. However, we must realize that this zero-padding will not 
improve the resolution, which depends on the length and shape of the window. This is 
illustrated by the next example. 



Sec. 1 0.2 DFT Analysis of Sinusoidal Signals 



711 



Example 10.7 DFT Analysis with 32-point Kaiser Window 
and Zero-Padding 

In this example we repeat Example 10.6 using the Kaiser window with L = 32 and 
/} = 5.48, and with the DFT length varying. Figure 10.9(a) shows the DFT magni- 
tude for N = L = 32 as in Figure 10.8(d), and Figures 10.9(b). (c). and (d) show the 
DFT magnitude again with L = 32, but with DFT lengths N = 64, vV = 128, and 
N = 1024, respectively. As with Example 10.5, this zero-padding of the 32-point se- 
quence results in finer spectral sampling of the discrete-time Fourier transform. The 
underlying envelope of each DFT magnitude in Figure 10.9 is the same. Consequently, 
increasing the DFT size by zero-padding does not change the ability to resolve the 
two sinusoidal frequency components, but it does change the spacing of the frequency 
samples. 
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Figure 10.9 Illustration of effect of DFT length for Kaiser window of length 
L = 32. (a) Magnitude of DFT for N = 32. (b) Magnitude of DFT for N = 64. 
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Figure 10.9 {continued) (c) Magnitude of DFT for A/ = 128. (d) Magnitude of 
DFT for N = 1 024. (DFT values are linearly interpolated to obtain a smooth curve.) 



For a complete representation of a sequence of length L, the L-point DFT is suf- 
ficient, since the original sequence can be recovered exactly from it. However, as we 
saw in the preceding examples, simple examination of the L-point DFT can result in 
misleading interpretations. For this reason, it is common to apply zero-padding so that 
the spectrum is sufficiently oversampled and important features are therefore read- 
ily apparent. With a high degree of time-domain zero-padding or frequency-domain 
oversampling, simple interpolation (e.g., linear interpolation) between the DFT val- 
ues provides a reasonably accurate picture of the Fourier spectrum, which can then be 
used, for example, to estimate the locations and amplitudes of spectral peaks. This is 
illustrated in the following example. 
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Example 10.8 Oversampling and Linear Interpolation for 
Frequency Estimation 

Figure 10.10 shows how a 1024-point DFT can be used to obtain a finely spaced 
evaluation of the Fourier transform of a windowed signal and how increasing the 
window width improves the ability to resolve closely spaced sinusoidal components. 
The signal of Example 10.6 was windowed with Kaiser windows of lengths L — 32, 42, 
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Figure 10.10 Illustration of the computation of the DFT for N » L with linear 
interpolation to create a smooth curve (a) N = 1024, L = 32(b) N = 1024, L = 
42 (c) N = 1024, L = 54 (d) N = 1024, L = 64. 
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54, and 64 with fi = 5.48. First note that in all cases, the 1024-point DFT gives a smooth 
result when the points are connected by straight lines. In Figure 10.10(a), where L — 32, 
the two sinusoidal components are not resolved, and, of course, increasing the DFT 
length will only result in a smoother curve. As the window length increases, however, 
we see steady improvement in our ability to distinguish the two frequencies and the 
approximate amplitudes of each sinusoidal component. Note that the 1024-point DFT 
in Figure 10.10(d) would be much more effective for precisely locating the peak of the 
windowed Fourier transform than the coarsely sampled DFT in Figure 10.8(b), which 
is also computed with a 64-point Kaiser window. Note also that the amplitudes of the 
two peaks in Figure 10.10 are very close to being in the correct ratio of 0.75 to 1. 



10.3 THE TIME-DEPENDENT FOURIER TRANSFORM 

The previous section illustrated the use of the DFT for obtaining a frequency-domain 
representation of a signal composed of sinusoidal components. In that discussion, we 
assumed that the frequencies of the cosines did not change with time so that no matter 
how long the window, the signal properties would be the same from the beginning to the 
end of the window. Often, in practical applications of sinusoidal signal models, the signal 
properties (amplitudes, frequencies, and phases) will change with time. For example, 
nonstationary signal models of this type are required to describe radar, sonar, speech, 
and data communication signals. A single DFT estimate is not sufficient to describe 
such signals, and as a result, we are led to the concept of the time -de pendent Fourier 
transform, also referred to as the short-time Fourier transform. 1 

The time-dependent Fourier transform of a signal x[n] is defined as 

DC 

X[n<k)= Y^ x[n + m]w[m]e- Jk '", (10.18) 

m = — oc 

where w[n] is a window sequence. In the time-dependent Fourier representation, the 
one-dimensional sequence x[n], a function of a single discrete variable, is converted into 
a two-dimensional function of the time variable /?, which is discrete, and the frequency 
variable A., which is continuous. 2 Note that the time-dependent Fourier transform is 
periodic in k with period 2jt, and therefore, we need consider only values of A, for 
< k < 2n or any other interval of length 2tt. 

Equation (10.18) can be interpreted as the Fourier transform of the shifted signal 
x [n+m] , as viewed through the window w [m] . The window has a stationary origin, and as 
n changes, the signal slides past the window so that, at each value of /?, a different portion 
of the signal is viewed. 

1 Further discussion of the time-dependent Fourier transform can be found in a variety of references, 
including Allen and Rabiner (1977), Rabiner and Schafer (1978), Crochiere and Rabiner (1983), and Nawab 
and Quatieri (1988). 

2 We denote the frequency variable of the time-dependent Fourier transform by A to maintain a distinc- 
tion from the frequency variable of the conventional discrete-time Fourier transform, which will be denoted 
co. We use the mixed bracket-parenthesis notation X [n. A) as a reminder that n is a discrete variable and A a 
continuous variable. 
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Example 1 0.9 Time-Dependent Fourier Transform 
of a Linear Chirp Signal 

The relationship of the window to the shifted signal is illustrated in Figure 10.1 1 for the 
signal 



x[n] = cos(t(j()/i ), coo = 2tt x 7.5 x 10 



-6 



(10.19) 



corresponding to a linear frequency modulation (i.e., the "instantaneous frequency 1 ' is 
2a>un). As we saw in Chapter 9 in the context of the chirp transform algorithm, a signal 
of this type is often referred to as a linear chirp. Typically, w[m] in Eq. (10. 18) has finite 
length around m = 0, so that X [n, X) displays the frequency characteristics of the signal 
around time n. For example, in Figure 10.12 we show a display of the magnitude of the 



iv \m\ 



v[225 + hi] 




1439 



H' [m 




400 



Figure 10.11 Two segments of the linear chirp signal x[n] = cos{co n 2 ) with the 
window superimposed. X [n. x) at n = 225 is the discrete-time Fourier transform 
of the top trace multiplied by the window. X [865, A) is the discrete-time Fourier 
transform of the bottom trace multiplied by the window. 
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Sample number (n) 

Figure 10.12 The magnitude of the time-dependent Fourier transform of x[n] = 
cos{co n 2 ) using a Hamming window of length 400. 
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time-dependent Fourier transform of the signal of Eq. (10.19) and Figure 10.11 with 
w[m] a Hamming window of length 400. In this display, referred to as a spectrogram, 
the vertical dimension k/2n is proportional to frequency and the horizontal dimension 
(n) is proportional to time. The magnitude of the time-dependent Fourier transform 
is represented by the darkness of the markings. In Figure 10.12, the linear progression 
of the frequency with time is clear. 

Since X[n, X) is the discrete-time Fourier transform of x[n + m]w[m], the time- 
dependent Fourier transform is invertible if the window has at least one nonzero sample. 
Specifically, from the Fourier transform synthesis equation (2.133), 

1 f 2n 
x[n + m]w[m] = — / X[n, k)e }km dk, -oo < m < oo, (10.20) 

from which it follows that 

2ttw[0] Jo 

if w[0] ^ 0. 3 Not just the single sample x[n], but all of the samples that are multiplied by 
nonzero samples of the window, can be recovered in a similar manner using Eq. (10.20). 
A rearrangement of the sum in Eq. (10.18) leads to another useful interpretation 
of the time-dependent Fourier transform. If we make the substitution tri = n + ra in 
Eq. (10.18), then X[n, A) can be written as 

oo 

X[n,k) = J2 x[m , ]w[-(n-m , )]e iki "- m '\ (10.22) 

m'= — co 

Equation (10.22) can be interpreted as the convolution 

X[n, k) = x[n] * h k [n], (10.23a) 

where 

h k [n] = w[-n]e> kn . (10.23b) 

From Eq. (10.23a), we see that the time-dependent Fourier transform as a function 
of n with k fixed can be interpreted as the output of a linear time-invariant filter with 
impulse response h k [n] or, equivalently, with frequency response 

H k {e ito ) = W{e* x - lo) ). (10.24) 

In general, a window that is nonzero for positive time will be called a noncausal 
window, since the computation of X [n, A) using Eq. (10.18) requires samples that/o//ow 
sample n in the sequence. Equivalently, in the linear-filtering interpretation, the impulse 
response h k [n] = w[—n]e ]kn is noncausal. 

In the definition of Eq. (10.18), the time origin of the window is held fixed and the 
signal is shifted past the interval of support of the window. This effectively redefines 
the time origin for Fourier analysis to be at sample n of the signal. Another possibility 
is to shift the window as n changes, keeping the time origin for Fourier analysis fixed at 

3 Since X[n, X) is periodic in X with period 2tz, the integration in Eqs. (10.20) and (10.21) can be over 
any interval of length 2n, 



Sec. 10.3 The Time-Dependent Fourier Transform 717 

the original time origin of the signal. This leads to a definition for the time-dependent 
Fourier transform of the form 

oc 

X[n.k) = Y^ x[m]w[m-n]e- >''■'". (10.25) 

DI — — -X. 

The relationship between the definitions of Eqs. (10.18) and (10.25) is easily shown to 
be 

X[n,k) = e-' k "X[n,k) (10.26) 

The definition of Eq. (10.18) is particularly convenient when we consider using 
the DFT to obtain samples in A. of the time-dependent Fourier transform, since, if w[m] 
is of finite length in the range < m < (L — 1), then so is x[n + m]w[w]. On the other 
hand, the definition of Eq. ( 1 0.25) has some advantages for the interpretation of Fourier 
analysis in terms of filter banks. Since our primary interest is in applications of the DFT, 
we will base our discussion on Eq. (10.18). 

10.3.1 The Effect of the Window 

The primary purpose of the window in the time-dependent Fourier transform is to limit 
the extent of the sequence to be transformed so that the spectral characteristics are 
reasonably stationary over the duration of the window. The more rapidly the signal 
characteristics change, the shorter the window should be. We saw in Section 10.2 that as 
the window becomes shorter, frequency resolution decreases. The same effect is true, 
of course, for X[n, k). On the other hand, as the window length decreases, the ability 
to resolve changes with time increases. Consequently, the choice of window length 
becomes a trade-off between frequency resolution and time resolution. 

The effect of the window on the properties of the time-dependent Fourier trans- 
form can be seen by assuming that the signal x[n] has a conventional discrete-time 
Fourier transform X(e^°). First let us assume that the window is unity for all m: i.e., 
assume that there is no window at all. Then, from Eq. (10.18), 

X[n,k) = X{e }/ )e r/ ". (10.27) 

Of course, a typical window for spectrum analysis tapers to zero so as to select only 
a portion of the signal for analysis. As discussed in Section 10.2, the length and shape 
of the window are chosen so that the Fourier transform of the window is narrow in 
frequency compared with variations with frequency of the Fourier transform of the 
signal. The Fourier transform of a typical window is illustrated in Figure 10.13(a). 

If we consider the time-dependent Fourier transform for fixed n, then it follows 
from the properties of Fourier transforms that 

X[n, k) = — f e i0n X{e jO )W{e j{A - O) )dO\ (10.28) 

2jt Vo 

i.e., the Fourier transform of the shifted signal is convolved with the Fourier transform 
of the window. This is similar to Eq. (10.2), except that in Eq. (10.2) we assumed that the 
signal was not successively shifted relative to the window. Here we compute a Fourier 
transform for each value of n. In Section 10.2 we saw that the ability to resolve two 
narrowband signal components depends on the width of the main lobe of the Fourier 
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Figure 10.13 (a) Fourier transform of 

2vr v T w a) window in time-dependent Fourier 

277 + A analysis, (b) Equivalent bandpass filter 

( b ) for time-dependent Fourier analysis. 



transform of the window, while the degree of leakage of one component into the vicinity 
of the other depends on the relative side-lobe amplitude. The case of no window at all 
corresponds to w[n] = 1 for all n. In this case W(e^" ) ) = 27t8(a)) for — it < ao < tt, which 
gives precise frequency resolution, but no time resolution. 

In the linear-filtering interpretation of Eqs. (10.23a), (10.23b), and (10.24), W(e J<l) ) 
typically has the lowpass characteristics depicted in Figure 10.13(a), and consequently, 
Hx(e^) is a bandpass filter whose passband is centered at a> — A, as depicted in Fig- 
ure 10.13(b). Clearly, the width of the passband of this filter is approximately equal to the 
width of the main lobe of the Fourier transform of the window. The degree of rejection 
of adjacent frequency components depends on the relative side-lobe amplitude. 

The preceding discussion suggests that if we are using the time-dependent Fourier 
transform to obtain a time-dependent estimate of the frequency spectrum of a signal, 
it is desirable to taper the window to lower the side lobes and to use as long a window 
as feasible to improve the frequency resolution. We will consider some examples in 
Section 10.5. However, before doing so, we discuss the use of the DFT in explicitly 
evaluating the time-dependent Fourier transform. 



10.3.2 Sampling in Time and Frequency 

Explicit computation of X[n, A) can be done only on a finite set of values of A, corre- 
sponding to sampling the time-dependent Fourier transform in the frequency variable 
domain. Just as finite-length signals can be exactly represented through samples of the 
discrete-time Fourier transform, signals of indeterminate length can be represented 
through samples of the time-dependent Fourier transform if the window in Eq. (10.18) 
has finite length. As an example, suppose that the window has length L with samples 



Sec. 10.3 The Time-Dependent Fourier Transform 719 

beginning at m — 0; i.e., 

w[m] — outside the interval < m < L — \ . (10.29) 

If we sample X[n, X) at N equally spaced frequencies X k — Ink/ /V, with N > L, then 
we can still recover the original sequence from the sampled time-dependent Fourier 
transform. Specifically, if we define X[n, k] to be 

L-\ 

X[n,k] = X[n,27Tk/N) = J2 x l n + m ] w l m ] ei{27T/N)k, "< 0<k<N-h (10.30) 

m=0 

then X[n, k] is the DFT of the windowed sequence x[n + m]H>[m]. Using the inverse 
DFT, we obtain 

1 " _1 
x[n+m]w[m] = - ^ X[n, k\e j{27T/N)k '\ 0<m<L-\. (10.31) 

Since we assume that the window w[m] ^ for < m < L — 1 , the sequence values can 
be recovered in the interval from n through (n + L — 1) using the equation 

1 "-' 
*[/i + wi] = -^-^ X[n,k}e ]{2n/N)k, \ ()<m< L-l, (10.32) 



Nw[m] 



k=() 



where it is assumed that w[m\ ^ for < m < L — 1. The important point is that the 
window has finite length and that we take at least as many samples in the X dimension as 
there are nonzero samples in the window; i.e., N > L. While Eq. (10.29) corresponds to 
a noncausal window, we could have used a causal window with w[m] ^ for — ( L — I) < 
m < or a symmetric window such that w[m] = w[—m] for \m\ < (L— l)/2, with Lan 
odd integer. The use of a noncausal window in Eq. (10.30) is simply more convenient 
for our analysis, since it leads very naturally to the interpretation of the sampled time- 
dependent Fourier transform as the DFT of the windowed sequence beginning with 
sample n. 

Since Eq. (10.30) corresponds to sampling Eq. (10.18) in A., it also corresponds 
to sampling Eqs. (10.22), (10.23a), and (10.23b) in k. Specifically, Eq. (10.30) can be 
rewritten as 

X[n,k]=x[n]*h k [n], 0<*< W-l, (10.33a) 

where 

h k [n] = w[-n]e j{2n/N)k ". (10.33b) 

Equations (10.33a) and (10.33b) can be viewed as a bank of N filters, as depicted in 
Figure 10.14, with the Ath filter having frequency response 

H k {e ji °) = w(e m27Tk/N) - M] ). (10.34) 

Our discussion suggests that x[n] for — oo < n < oo can be reconstructed if X[n, I) 
or X[n, k] is sampled in the time dimension as well. Specifically, using Eq. (10.32), we 
can reconstruct the signal in the interval n^ < n < n^ + L — 1 from A^/io, &], and we 
can reconstruct the signal in the interval no + L < n < «o + 2L - 1 from X[no + L<k\ 
etc. Thus, x [n] can be reconstructed exactly from the time-dependent Fourier transform 
sampled in both the frequency and the time dimension. In general, for the region of 
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Figure 10.14 Filter bank 
representation of the time-dependent 
Fourier transform. 



support of the window as specified in Eq. (10.29), we define this sampled timc-dcpcndent 
Fourier transform as 

L-\ 

X[rR.k\ = X[rR.2jrk/N) = ^x[r R + m]w[m]e^ {2ir/N)km . (10.35) 



/»=!) 



where r and k are integers such that — oo < r < oo and < k < N — 1. To further 
simplify our notation, we define 

X r [k] = X[rR.k] = X[rR,X. k ), -oo < r < oo, 0<£<N-1, (10.36) 

where X k = Ink/N. This notation denotes explicitly that the sampled time-dependent 
Fourier transform is simply a sequence of vV-point DFTs of the windowed signal seg- 
ments 

jc r [m] = jc[r/? + m]n'[m], — oo < r < oo, < m < L — 1 , (10.37) 

with the window position moving in jumps of R samples in time. Figure 10.15 shows 
lines in the [n, A)-plane corresponding to the region of support of X\n, k) and the grid 
of sampling points in the [n, A)-plane for the case N = 10 and R = 3. As we have shown, 
it is possible to uniquely reconstruct the original signal from such a two-dimensional 
discrete representation. 

Equation (10.35) involves the following integer parameters: the window length 
L; the number of samples in the frequency dimension, or the DFT length /V; and the 
sampling interval in the time dimension, R. However, not all choices of these parameters 
will permit exact reconstruction of the signal. The choice L < N guarantees that we can 
reconstruct the windowed segments x r [m\ from the block transforms A7[/:]. If R < L, 
the segments overlap, but if R > L, some of the samples of the signal are not used 
and therefore cannot be reconstructed from X r [k]. Thus, in general, the three sampling 
parameters should satisfy the relation N > L > R. Notice that each block of R samples 
of the signal is represented by N complex numbers in the sampled time-dependent 
Fourier representation; or, if the signal is real, only N real numbers are required, due to 
the symmetry of the DFT. As previously shown, the signal can be reconstructed exactly 
from the sampled time-dependent Fourier transform for the special case N = L = R. 
In this case, N samples of a real signal are represented by N real numbers, and this is 
the minimum that we could expect to achieve for an arbitrarily chosen signal. 

Another way to see that the time-dependent Fourier transform can be sampled 
in the time dimension is to recall that for fixed A, or equivalently, for fixed k, the time- 
dependent Fourier transform is a one-dimensional sequence that is the output of a 
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Figure 10.15 (a) Region of support for X [n, A), (b) Grid of sampling points in 
the [n, A)-plane for the sampled time-dependent Fourier transform with N = 10 
and R = 3. 



bandpass filter with frequency response as in Eq. (10.24). Thus, we expect that the 
sampling rate of the sequences representing each of the frequencies could be reduced 
by a factor 2jr/A m \, where A ml is the width of the main lobe of the Fourier transform 
of the window. Figure 10.16(a) shows the set of bandpass filters corresponding to a 
rectangular window with L = N = 16. Note that the passbands of the filters overlap 
significantly, and their frequency selectivity is not ideal by any standard. In fact the 
sidelobes of any one of the bandpass filters overlap completely with the passbands on 
either side. This suggests that we might encounter a problem with aliasing in the time 
dimension, since the Fourier transform of any other finite-length window will not be an 
ideal filter response either. For example, Figure 10.16(b) shows the case for a Kaiser 
window of the same length, i.e., L = N = 16. The sidelobes are much smaller, but the 
mainlobe is much wider, so the filters overlap considerably. Although it is not obvious 
by looking at Figure 10.16, the previous argument based on block processing ideas 
shows conclusively that we can nevertheless reconstruct the original signal exactly from 
the time- and frequency-sampled time-dependent Fourier transform. A more detailed 
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Figure 10.16 Filterbank frequency response, (a) Rectangular window, (b) Kaiser 
window. 



analysis of the linear-filtering point of view shows that the aliasing distortion due to the 
nonideal frequency responses can be canceled in the reconstruction process. This point 
is considered in Problem 10.40 and is discussed in detail in Rabiner and Schafer (1978) 
and Crochiere and Rabiner (1983). 



1 0.4 BLOCK CONVOLUTION USING 

THE TIME-DEPENDENT FOURIER TRANSFORM 



One of the uses of the time-dependent Fourier transform is as a basis for processing 
a discrete-time signal by performing the modifications in the frequency domain. This 
is done by computing a time-dependent Fourier transform representation, modifying 
that representation, and then reconstructing a discrete-time signal. This approach is 
widely used in digital speech coding, where, instead of quantizing the samples of the 
speech signal, the sampled time-dependent Fourier transform is quantized and coded 
for either transmission or storage. A discussion of applications of this type would take 
us too far afield; however, these kinds of block-processing techniques for discrete-time 



Sec. 10.5 Fourier Analysis of Nonstationary Signals 723 

signals were also introduced in Chapter 8 when we discussed the use of the DFT for 
implementing the convolution of a finite-length impulse response with an input signal 
of indefinite length. This method of implementation of linear time-invariant systems 
has a useful interpretation in terms of the definitions and concepts of Section 10.3. 

Assume that x[n] =0for« < 0, and suppose that we compute the time-dependent 
Fourier transform for R = L and a rectangular window. In other words, the sampled 
time-dependent Fourier transform X r [k] consists of a set of Appoint DFTs of segments 
of the input sequence 

x r [m] = x[rL + m], 0<m< L-l. (10.38) 

Since each sample of the signal x[n] is included and the blocks do not overlap, it follows 
that 

x[n] = Y^ x r[n-rL]. (10.39) 

r=() 

Now suppose that we define a new time-dependent Fourier transform 

Y r [k] = H[k]X r [k], 0</c</V-l, (10.40) 

where H[k] is the yV-point DFT of a finite-length unit sample sequence h[n] such that 
h[n\ = Ofor n < and for n > P — 1. If we compute the inverse DFT of Y r [k], we obtain 

1 A/-1 N-] 

y r [m] = - ]T Yr [k]e^ 2jt/N)km = Y,x r [e]h[((m - i)) N ]. (10.41) 

That is, y r [m] is the jY-point circular convolution of h[m] and x r [m]. Since h[m] has length 
P samples and x r [m] has length L samples, it follows from the discussion of Section 8.7 
that if N > L+ P — 1 , then y r [m] will be identical to the linear convolution of h [m] with 
x r [m] in the interval 0<ra< L+ P — 2, and it will be zero otherwise. Thus, it follows 
that if we construct an output signal 

DC 

y[n] = Y,yrl"->-Ll (10.42) 

then y[n] is the output of a linear time-invariant system with impulse response h[n\. 
The procedure just described corresponds exactly to the overlap-add method of block 
convolution. The overlap-save method discussed in Section 8.7 can also be applied 
within the framework of the time-dependent Fourier transform. 



10.5 FOURIER ANALYSIS OF NONSTATIONARY SIGNALS 

In Section 10.4, we considered a simple example of how the time-dependent Fourier 
transform can be used to implement linear filtering. In such applications, we are not 
so much interested in spectral resolution as in whether it is possible to reconstruct a 
modified signal from the modified time-dependent Fourier transform. On the other 
hand, the concept of the time-dependent Fourier transform is perhaps most widely 
used as a framework for a variety of techniques for obtaining spectral estimates for 
nonstationary discrete-time signals, and in these applications spectral resolution, time 
variation, and other issues are the most important. 
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A nonstationary signal is a signal whose properties vary with time, for example, a 
sum of sinusoidal components with time -varying amplitudes, frequencies, or phases. As 
we will illustrate in Section 10.5.1 for speech signals and in Section 10.5.2 for Doppler 
radar signals, the time-dependent Fourier transform often provides a useful description 
of how the signal properties change with time. 

When we apply time-dependent Fourier analysis to a sampled signal, the entire 
discussion of Section 10.1 holds for each DFT that is computed. In other words, for 
each segment x r [n] of the signal, the sampled time-dependent Fourier transform X r [k] 
would be related to the Fourier transform of the original continuous-time signal by 
the processes described in Section 10.1. Furthermore, if we were to apply the time- 
dependent Fourier transform to sinusoidal signals with constant (i.e., non-time-varying) 
parameters, the discussion of Section 10.2 should also apply to each of the DFTs that we 
compute. When the signal frequencies do not change with time, it is tempting to assume 
that the time-dependent Fourier transform would vary only in the frequency dimension 
in the manner described in Section 10.2, but this would be true only in very special 
cases. For example, the time-dependent Fourier transform will be constant in the time 
dimension if the signal is periodic with period N p and L ~ £qN p and R — roN p , where 
£q and r {) are integers; i.e., the window includes exactly £ periods, and the window is 
moved by exactly r periods between computations of the DFT. In general, even if the 
signal is exactly periodic, the varying phase relationships that would result as different 
segments of the waveform are shifted into the analysis window would cause the time- 
dependent Fourier transform to vary in the time dimension. However, for stationary 
signals, if we use a window that tapers to zero at its ends, the magnitude lA^/c]! will 
vary only slightly from segment to segment, with most of the variation of the complex 
time-dependent Fourier transform occurring in the phase. 

10.5.1 Time-Dependent Fourier Analysis of Speech Signals 

Speech is produced by excitation of an acoustic tube, the vocal tract, which is terminated 
on one end by the lips and on the other end by the glottis. There are three basic classes 
of speech sounds: 

• Voiced sounds are produced by exciting the vocal tract with quasi-periodic pulses 
of airflow caused by the opening and closing of the glottis. 

• Fricative sounds are produced by forming a constriction somewhere in the vocal 
tract and forcing air through the constriction so that turbulence is created, thereby 
producing a noiselike excitation. 

• Plosive sounds are produced by completely closing off the vocal tract, building up 
pressure behind the closure, and then abruptly releasing the pressure. 

Detailed discussions of models for the speech signal and applications of the time- 
dependent Fourier transform are found in texts such as Flanagan (1972), Rabiner and 
Schafer (1978), O'Shaughnessy (1987), Parsons (1986), and Deller et al. (1993). 

With a constant vocal tract shape, speech can be modeled as the response of a linear 
time-invariant system (the vocal tract) to a quasi-periodic pulse train for voiced sounds 
or wideband noise for unvoiced sounds. The vocal tract is an acoustic transmission 
system characterized by its natural frequencies, called formants, which correspond to 
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resonances in its frequency response. In normal speech, the vocal tract changes shape 
relatively slowly with time as the tongue and lips perform the gestures of speech, and 
thus it can be modeled as a slowly time-varying filter that imposes its frequency-response 
properties on the spectrum of the excitation. A typical speech waveform is shown in 
Figure 10.17. 

From this brief description of the process of speech production and from Fig- 
ure 10.17, we see that speech is clearly a nonstationary signal. However, as illustrated in 
the figure, the characteristics of the signal can be assumed to remain essentially constant 
over time intervals on the order of 30 or 40 ms. The frequency content of the speech 
signal may range up to 15 kHz or higher, but speech is highly intelligible even when 
bandlimited to frequencies below about 3 kHz. Commercial telephone systems, for ex- 
ample, typically limit the highest transmitted frequency to about 3 kHz. A standard 
sampling rate for digital telephone communication systems is 8000 samples/s. At this 
sampling rate, a 40-ms time interval is spanned by 320 samples. 

Figure 10.17 shows that the waveform consists of a sequence of quasi-periodic 
voiced segments interspersed with noiselike unvoiced segments. This figure suggests 
that if the window length L is not too long, the properties of the signal will not change 
appreciably from the beginning of the segment to the end. Thus, the DFT of a windowed 
speech segment should display the frequency-domain properties of the signal at the time 
corresponding to the window location. For example, if the window length is long enough 
so that the harmonics are resolved, the DFT of a windowed segment of voiced speech 
should show a series of peaks at integer multiples of the fundamental frequency of the 
signal in that interval. This would normally require that the window span several periods 
of the waveform. If the window is too short, then the harmonics will not be resolved, but 
the general spectral shape will still be evident. This is typical of the trade-off between 
frequency resolution and time resolution that is required in the analysis of nonstationary 
signals. If the window is too long, the signal properties may change too much across 
the window; if the window is too short, resolution of narrowband components will be 
sacrificed. This trade-off is illustrated in the following example. 



Example 10.10 Spectrogram Display 

of the Time-Dependent Fourier Transform of Speech 

Figure 10.18(a) shows a spectrogram display of the time-dependent Fourier trans- 
form of the sentence in Figure 10.17. The time waveform is also shown on the same 
time scale, below the spectrogram. More specifically, Figure 10.18(a) is a wideband 
spectrogram. A wideband spectrogram representation results from a window that is 
relatively short in time and is characterized by poor resolution in the frequency di- 
mension and good resolution in the time dimension. The frequency axis is labeled 
in terms of continuous-time frequency. Since the sampling rate of the signal was 
16,000 samples/s, it follows that the frequency X = n corresponds to 8 kHz. The 
specific window used in Figure 10.18(a) was a Hamming window of duration 6.7 
ms, corresponding to L = 108. The value of R was 16, representing 1-ms time in- 
crements. The broad, dark bars that move horizontally across the spectrogram cor- 
respond to the resonance frequencies of the vocal tract, which, as we see, change 
with time. The vertically striated appearance of the spectrogram is due to the quasi- 
periodic nature of voiced portions of the waveform, as is evident by comparing the 
variations in the waveform display and the spectrogram. Since the length of the 
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analysis window is on the order of the length of a period of the waveform, as the window 
slides along in time it alternately covers high-energy segments of the waveform and 
then lower energy segments in between, thereby producing the vertical striations in 
the plot during voiced intervals. 

In a narrowband time-dependent Fourier analysis, a longer window is used to 
provide higher frequency resolution, with a corresponding decrease in time resolution. 
Such a narrowband analysis of speech is illustrated by the display in Figure 10.18(b). 
In this case, the window was a Hamming window of duration 45 ms. This corresponds 
to L — 720. The value of R was again 16. 
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Figure 10.18 (a) Wideband spectrogram of waveform of Figure 10.17. 
(b) Narrowband spectrogram. 
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This example only hints at the many reasons that the time-dependent Fourier 
transform is so important in speech analysis and processing. Indeed, the concept is 
used directly and indirectly as the basis for acoustic-phonetic analysis and for many 
fundamental speech-processing applications, such as digital coding, noise and reverber- 
ation removal, speech recognition, speaker verification, and speaker identification. For 
present purposes, our discussion simply serves as an introductory illustration. 

10.5.2 Time-Dependent Fourier Analysis of Radar Signals 

Another application area in which the time-dependent Fourier transform plays an 
important role is radar signal analysis. The following are elements of a typical radar 
system: 

• Antennas for transmitting and receiving (often the same). 

• A transmitter that generates an appropriate signal at microwave frequencies. In 
our discussion, we will assume that the signal consists of sinusoidal pulses. While 
this is often the case, other signals may be used, depending on the specific radar 
objectives and design. 

• A receiver that amplifies and detects echoes of the transmitted pulses that have 
been reflected from objects illuminated by the antenna. 

In such a radar system, the transmitted sinusoidal signal propagates at the speed of 
light, reflects off the object, and returns at the speed of light to the antenna, thereby 
undergoing a time delay of the round-trip travel time from the antenna to the object. 
If we assume that the transmitted signal is a sinusoidal pulse of the form cos(£2 and 
the distance from the antenna to the object is p(t), then the received signal is a pulse of 
the form 

s(t) = cos[£2 (t - 2p(t)/c)], (10.43) 

where c is the velocity of light. If the object is not moving relative to the antenna, then 
p(t) = p Q , where po is the range. Since the time delay between the transmitted and 
received pulses is Ip^/c, a measurement of the time delay may be used to estimate 
the range. If, however, p(t) is not constant, the received signal is an angle-modulated 
sinusoid and the phase difference contains information about both the range and the 
relative motion of the object with respect to the antenna. Specifically, let us represent 
the time-varying range in a Taylor's series expansion as 

1 

p(t) = p + pot + ~p t 2 + • • • , (10.44) 

where p is the nominal range, p is the velocity, po is the acceleration, and so on. 
Assuming that the object moves with constant velocity (i.e., p = 0), and substituting 
Eq. (10.44) into Eq. (10.43), we obtain 

s(t) = cos[(^ - 2£2 po/c)t - 2£l po/c]. (10.45) 
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In this case, the frequency of the received signal differs from the frequency of the 
transmitted signal by the Doppler frequency, defined as 

fi rf = -2n Po/c (10.46) 

Thus, the time delay can still be used to estimate the range, and we can determine the 
speed of the object relative to the antenna if we can determine the Doppler frequency. 

In a practical setting, the received signal is generally very weak, and thus a noise 
term should be added to Eq. (10.45). We will neglect the effects of noise in the simple 
analysis of this section. Also, in most radar systems, the signal of Eq. (10.45) would be 
frequency shifted to a lower nominal frequency in the detection process. However, the 
Doppler shift will still satisfy Eq. (10.46), even if s(t) is demodulated to a lower center 
frequency. 

To apply time-dependent Fourier analysis to such signals, we first bandlimit the 
signal to a frequency band that includes the expected Doppler frequency shifts and then 
sample the resulting signal with an appropriate sampling period 7\ thereby obtaining a 
discrete-time signal of the form 

x[n] = cos[(oj — 2o){)P()/c)n — 2ojoPo/c], (10.47) 

where coq = Qq T, In many cases, the object's motion would be more complicated than we 
have assumed, requiring the incorporation of higher order terms from Eq. (10.44) and 
thereby producing a more complicated angle modulation in the received signal. Another 
way to represent this more complicated variation of the frequency of the echoes is to 
use the time-dependent Fourier transform with a window that is short enough so that 
the assumption of constant Doppler-shifted frequency is valid across the entire window 
interval, but not so short as to sacrifice adequate resolution when two or more moving 
objects create Doppler-shifted return signals that are superimposed at the receiver. 

Example 10.1 1 

An example of time-dependent Fourier analysis of Doppler radar signals is shown in 
Figure 10.19. (See Schaefer et al., 1979.) The radar data had been preprocessed to 
remove low-velocity Doppler shifts, leaving the variations displayed in the figure. The 
window for the time-dependent Fourier transform was a Kaiser window with N = 
L — 64 and /? = 4. In the figure, | AV[/c]| is plotted with time as the vertical dimension 
(increasing upward) and frequency as the horizontal dimension. 4 In this case, the 
successive DFTs are plotted close together. A hidden-line elimination algorithm is 
used to create a two-dimensional view of the time-dependent Fourier transform. To 
the left of the centerline is a strong peak that moves in a smooth path through the 
time-frequency plane. This corresponds to a moving object whose velocity is varying 
in a regular manner. The other broad peaks in the time-dependent Fourier transform 
are due to noise and spurious returns called clutter m radar terminology. An example of 
motion that might create such a variation of the Doppler frequency is a rocket moving 
at constant velocity, but rotating about its longitudinal axis. A peak moving through the 

4 The plot shows the negative frequencies on the left of the line through the center of the plot and 
positive frequencies on the right. This can be achieved by computing the DFT of ( — \)"x r [n] and noting that 
the computation effectively shifts the origin of the DFT index to k = N/2. Alternatively, the DFT of x r [n] 
can be computed and then reindexed. 
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time-dependent Fourier transform might correspond to reflections from a fin on the 
rocket that is alternately moving toward and then away from the antenna because of 
the spinning of the rocket. Figure 10.1 9(b) shows an estimate of the Doppler frequency 
as a function of time. This estimate was obtained simply by locating the highest peak 
in each DFT. 

Short-time Fourier analysis 




0.577 - 



-0.5 




Radian frequency 
(a) 



Figure 10.19 Illustration of time-dependent Fourier analysis of Doppler radar 
signal, (a) Sequence of Fourier transforms of Doppler radar signal, (b) Doppler 
frequency estimated by picking the largest peak in the time-dependent Fourier 
transform. 



1 0.6 FOURIER ANALYSIS OF STATIONARY RANDOM 
SIGNALS: THE PERIODOGRAM 



In the previous sections, we discussed and illustrated Fourier analysis for sinusoidal 
signals with stationary (non-time-varying) parameters and for nonstationary signals 
such as speech and radar. In cases where the signal can be modeled by a sum of sinusoids 
or a linear system excited by a periodic pulse train, the Fourier transforms of finite-length 
segments of the signal have a convenient and natural interpretation in terms of Fourier 
transforms, windowing, and linear system theory. However, more noiselike signals, such 
as the example of unvoiced speech in Section 10.5.1 , are best modeled as random signals. 
As we discussed in Section 2.10 and as shown in Appendix A, random processes 
are often used to model signals when the process that generates the signal is too complex 
for a reasonable deterministic model. Typically, when the input to a linear time-invariant 
system is modeled as a stationary random process, many of the essential characteristics 
of the input and output are adequately represented by averages, such as the mean 
value (dc level), variance (average power), autocorrelation function, or power density 
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spectrum. Consequently, it is of particular interest to estimate these for a given signal. 
As discussed in Appendix A, a typical estimate of the mean value of a stationary random 
process from a finite-length segment of data is the sample mean, defined as 

1 L ] 
m, = -^2x[n], (10.48) 

#i=0 

Similarly, a typical estimate of the variance is the sample variance, defined as 

1 L ~ l 
^ = ^J2(x[n]-m x f. (10.49) 

n=() 

The sample mean and the sample variance, which are themselves random variables, are 
unbiased and asymptotically unbiased estimators, respectively; i.e., the expected value 
of m x is the true mean m x and the expected value of a\ 2 approaches the true variance a^ 
as L approaches do. Furthermore, they are both consistent estimators; i.e., they improve 
with increasing L, since their variances approach zero as L approaches oo. 

In the remainder of this chapter, we study the estimation of the power spectrum^ of 
a random signal using the DFT. As we will see, there are two basic approaches to estimat- 
ing the power spectrum. One approach, which we develop in this section, is referred to as 
periodogram analysis and is based on direct Fourier transformation of finite-length seg- 
ments of the signal. The second approach, developed in Section 10.7, is to first estimate 
the autocovariance sequence and then compute the Fourier transform of this estimate. 
In either case, we are typically interested in obtaining unbiased consistent estimators. 
Unfortunately, the analysis of such estimators is very difficult, and generally, only ap- 
proximate analyses can be accomplished. Even approximate analyses are beyond the 
scope of this text, and we refer to the results of such analyses only in a qualitative way. De- 
tailed discussions are given in Blackman and Tukey (1958), Hannan (1960), Jenkins and 
Watts (1968), Koopmans (1995), KayandMarple (1981 ),Marple (1987), and Kay (1988). 

10.6.1 The Periodogram 

Let us consider the problem of estimating the power density spectrum P SS (Q) of a 
continuous-time signal s c (t). An intuitive approach to the estimation of the power 
spectrum is suggested by Figure 10.1 and the associated discussion in Section 10.1; based 
on that approach, we now assume that the input signal s c (t) is a stationary random 
signal. The antialiasing lowpass filter creates a new stationary random signal whose 
power spectrum is bandlimited, so that the signal can be sampled without aliasing. Then 
x[n] is a stationary discrete-time random signal whose power density spectrum P xx (co) 
is proportional to P SS (Q) over the bandwidth of the antialiasing filter; i.e., 

P xx (a>) = -P ss (|) , M < 7T, (10.50) 

where we have assumed that the cutoff frequency of the antialiasing filter is izj T 
and that T is the sampling period. (See Problem 10.33 for a further consideration of 

5 The term power spectrum is commonly used interchangeably with the more precise term power density 
spectrum. 
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sampling of random signals.) Consequently, a reasonable estimate of P xx (oj) will provide 
a reasonable estimate of P SS (Q). The window w[n] in Figure 10.1 selects a finite-length 
segment (L samples) of x[n], which we denote u[n], the Fourier transform of which is 

LI 

V(e jco ) = J2 ^[n\x[n]e- jcon . (10.51) 

Consider as an estimate of the power spectrum the quantity 

I(o>) = ^ u \V(en\ 2 , (10.52) 

where the constant U anticipates a need for normalization to remove bias in the spectral 
estimate. When the window w[n] is the rectangular window sequence, this estimator for 
the power spectrum is called the periodogram. If the window is not rectangular, 1(a)) 
is called the modified periodogram. Clearly, the periodogram has some of the basic 
properties of the power spectrum. It is nonnegative, and for real signals, it is a real and 
even function of frequency. Furthermore, it can be shown (Problem 10.26) that 

L-l 
m = -{L-\) 

where 

L-\ 

c vv \m\ = y_\ x[n\w[n\x[n + m]w[n + m\. (10.54) 

«=o 

We note that the sequence c vu [/w] is the aperiodic correlation sequence for the finite- 
length sequence v[ri] = w[n]x[n]. Consequently, the periodogram is in fact the Fourier 
transform of the aperiodic correlation of the windowed data sequence. 

Explicit computation of the periodogram can be carried out only at discrete fre- 
quencies. From Eqs. (10.51) and (10.52), we see that if the discrete-time Fourier trans- 
form of w[/2]jt[/i] is replaced by its DFT, we will obtain samples at the DFT frequencies 
cok = Ink/ N for k = 0, 1. . . . , N — 1. Specifically, samples of the periodogram are given 
by 

l(o> k ) = -^j\V[k}\ 2 , (10.55) 

where V[k] is the Appoint DFT of w [«]*[«]. If we want to choose N to be greater 
than the window length L, appropriate zero-padding would be applied to the sequence 
w[n]x[ri\. 

If a random signal has a nonzero mean, its power spectrum has an impulse at 
zero frequency. If the mean is relatively large, this component will dominate the spec- 
trum estimate, causing low-amplitude, low-frequency components to be obscured by 
leakage. Therefore, in practice the mean is often estimated using Eq. (10.48), and the 
resulting estimate is subtracted from the random signal before computing the power 
spectrum estimate. Although the sample mean is only an approximate estimate of the 
zero-frequency component, subtracting it from the signal often leads to better estimates 
at neighboring frequencies. 
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10.6.2 Properties of the Periodogram 

The nature of the periodogram estimate of the power spectrum can be determined by 
recognizing that, for each value of oj, I(co) is a random variable. By computing the mean 
and variance of /(&>), we can determine whether the estimate is biased and whether it 
is consistent. 

From Eq. (10.53), the expected value of I(co) is 

£{I(co)} = — Y, £{Cv,[m]}e-'"""- (10-56) 

m=-(l.-\) 

The expected value of <:„„[/??] can be expressed as 



L-\ 



E{c vv \m\) = Y^£{jc[h]w[/7],v[h + m]w[/i +/«]} 



//=o 



(10.57) 



= Y^ w[w]vv[/i + m\E {x\n\x\n + /??]}. 

Since we are assuming that x[n] is stationary, 

£{x[n]x[n + m]} = <p xx [m], (10.58) 

and Eq. (10.57) can then be rewritten as 

^{cVrM} = c l , lv [iw]0. r . v H, (10.59) 

where c HH ,[m] is the aperiodic autocorrelation of the window, i.e., 

c ww [m] = Y^ w[«]w[w + m]. (10.60) 

/i=0 

FromEq. (10.56), Eq. (10.59), and the modulation-windowing property of Fourier 
transforms (Section 2.9.7), it follows that 

£{/(")} = ^Am / T P,A0)C ww (e i(M 0) )d0, (10.61) 

In LU J_ 7T 

where C ww (e }w ) is the Fourier transform of the aperiodic autocorrelation of the window, 
i.e., 

C ww (e^) = \W(en\ 2 . (10.62) 

According to Eq. (10.61), the (modified) periodogram is a biased estimate of the 
power spectrum, since S[ I(<o)} is not equal to P xx (co). Indeed, we see that the bias arises 
as a result of convolution of the true power spectrum with the Fourier transform of 
the aperiodic autocorrelation of the data window. If we increase the window length, we 
expect that W(e^ ( °) should become more concentrated around w = 0, and thus C ww (e^ y ) 
should look increasingly like a periodic impulse train. If the scale factor \/(LU) is 
correctly chosen, then £{/(&>)} should approach P xx (aj) as W(e ,co ) approaches a periodic 
impulse train. The scale can be adjusted by choosing the normalizing constant U so that 

J" \W(e"")\ 2 dco = ■— £M«]) 2 = 1. (10.63) 



2nLU ..... _. „ 

n—Q 
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or 



1 L ~ x 
£/=-5>,[/i]) 2 . 



(10.64) 



n=0 



For the rectangular window, we would then choose U = 1 , while other data windows 
would require a value of < U < 1 if w[n] is normalized to a maximum value of 1. 
Alternatively, the normalization can be absorbed into the amplitude of w[n]. Therefore, 
if properly normalized, the (modified) periodogram is asymptotically unbiased; i.e., the 
bias approaches zero as the window length increases. 

To examine whether the periodogram is a consistent estimate or becomes a consis- 
tent estimate as the window length increases, it is necessary to consider the behavior of 
the variance of the periodogram. An expression for the variance of the periodogram is 
very difficult to obtain even in the simplest cases. However, it has been shown (see Jenk- 
ins and Watts, 1968) that over a wide range of conditions, as the window length increases, 



var[/(o))] - P v 2 ». 



(10.65) 



That is, the variance of the periodogram estimate is approximately the same size as the 
square of the power spectrum that we are estimating. Therefore, since the variance does 
not asymptotically approach zero with increasing window length, the periodogram is 
not a consistent estimate. 

The properties of the periodogram estimate of the power spectrum just discussed 
are illustrated in Figure 10.20, which shows periodogram estimates of white noise us- 
ing rectangular windows of lengths L = 16,64,256, and 1024. The sequence x[n] 
was obtained from a pseudorandom-number generator whose output was scaled so 
that \x[n]\ < >/3. A good random-number generator produces a uniform distribution 
of amplitudes, and the sample-to-sample correlation is small. Thus, the power spec- 
trum of the output of the random-number generator could be modeled in this case by 
P xx (oj) = ol — 1 for all a). For each of the four rectangular windows, the periodogram 
was computed with normalizing constant U — 1 and at frequencies wk = 27rk/N for 




128 



256 
Sample number (k) 

(a) 



384 



512 



Figure 10.20 Periodograms of 
pseudorandom white-noise sequence, 
(a) Window length L = 16 and DFT 
length N = 1024. 
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N = 1024 using the DFT. That is, 



I[k] = I(w k ) = ^\Vlk]\ 2 = ^ 



L-\ 



^w[n]x[n]e-^ tN)kn 



n=0 



(10.66) 



In Figure 10.20, the DFT values are connected by straight lines for purposes of display. 
Recall that J(w) is real and an even function of w so we only need to plot I[k] for 
< k < N/2 corresponding to < co < n. We note that the spectral estimate fluctuates 
more rapidly as the window length L increases. This behavior can be understood by re- 
calling that, although we view the periodogram method as a direct computation of the 
spectral estimate, we have seen that the underlying correlation estimate of Eq. (10.54) 
is, in effect, Fourier transformed to obtain the periodogram. Figure 10.21 illustrates a 
windowed sequence, x[/?]w[/7], and a shifted version. x[n + m]w[/? + m], as required 
in Eq. (10.54). From this figure, we see that L — m— 1 signal values are involved in 
computing a particular correlation lag value c lu ,[m]. Thus, when m is close to L, only 
a few values of x[n] are involved in the computation, and we expect that the estimate 
of the correlation sequence will be considerably more inaccurate for these values of 
m and consequently will also show considerable variation between adjacent values of 
m. On the other hand, when m is small, many more samples are involved, and the 
variability of c |ir [m] with m should not be as great. The variability at large values of 
m manifests itself in the Fourier transform as fluctuations at all frequencies, and thus, 
for large L, the periodogram estimate tends to vary rapidly with frequency. Indeed, it 
can be shown (see Jenkins and Watts, 1968) that if N — L, the periodogram estimates 
at the DFT frequencies lixkjN become uncorrelated. Since, as N increases, the DFT 
frequencies get closer together, this behavior is inconsistent with our goal of obtaining 
a good estimate of the power spectrum. We would prefer to obtain a smooth spectrum 
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Figure 10.21 Illustration of sequences 
involved in Eq. (10.54). (a) A 
finite-length sequence, (b) Shifted 
sequence for m > 0. 
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estimate without random variations resulting from the estimation process. This can be 
accomplished by averaging multiple independent periodogram estimates to reduce the 
fluctuations. 

10.6.3 Periodogram Averaging 

The averaging of periodograms in spectrum estimation was first studied extensively by 
Bartlett (1953); later, after fast algorithms for computing the DFT were developed, 
Welch (1970) combined these computational algorithms with the use of a data window 
w[n] to develop the method of averaging modified periodograms. In periodogram aver- 
aging, a data sequence x[n],0 <n < Q— 1, is divided into segments of length- L samples, 
with a window of length L applied to each; i.e., we form the segments 

x r [/i] = ;c[rK+/t]w[#t], 0<« < L-l. (10.67) 

If R < L the segments overlap, and for R = L the segments are contiguous. Note that Q 
denotes the length of the available data. The total number of segments depends on the 
values of, and relationship among, /?, L, and Q. Specifically, there will be K full-length 
segments, where K is the largest integer for which (K - l)R + (L - 1) < Q - 1. The 
periodogram of the rth segment is 

i r (co)=jjj\X r (en\ 2 , (10.68) 

where X r (e luj ) is the discrete-time Fourier transform of x r [n]. Each l r {(o) has the prop- 
erties of a periodogram, as described previously. Periodogram averaging consists of 
averaging together the K periodogram estimates I r (a>); i.e., we form the time-averaged 
periodogram defined as 

1 * _1 
/M = -^/ r (4 (10.69) 

To examine the bias and variance of I(co), let us take L — R, so that the segments 
do not overlap, and assume that <p X x[m] is small for m > L\ i.e., signal samples more 
than L apart are approximately uncorrected. Then it is reasonable to assume that 
the periodograms I r (co) will be identically distributed independent random variables. 
Under this assumption, the expected value of I(cu) is 

1 K ~ l 
S[I(co)}^-TS[Ir{oj)h (10.70) 

or, since we assume that the periodograms are independent and identically distributed, 

£{I(a>)} = S{I r (a>)} for any r. (10.71) 

From Eq. (10.61), it follows that 

£{I(a>)) = £[Ir(a>)} = ^4-77 T Px X {0)C ww (e j((O - e) )d0, (10.72) 

2xLu J_ n 

where L is the window length. When the window w[n] is the rectangular window, the 
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method of averaging periodograms is called Bartletfs procedure, and in this case it can 
be shown that 

and, therefore, 

C^n={^§) 2 . (10.74) 

\ sin(a>/2) / 

That is, the expected value of the average periodogram spectrum estimate is the convo- 
lution of the true power spectrum with the Fourier transform of the triangular sequence 
c„[«] that results as the autocorrelation of the rectangular window. Thus, the average 
periodogram is also a biased estimate of the power spectrum. 

To examine the variance, we use the fact that, in general, the variance of the aver- 
age of K independent identically distributed random variables is 1/ K times the variance 
of each individual random variable. (See Papoulis, 1991.) Therefore, the variance of the 
average periodogram is 

var[/(w)]=:ivar[/ r M], (10.75) 

or, with Eq. (10.65), it follows that 

var[I(<o)]~±P? x (a>). (10.76) 

Consequently, the variance of I(co) is inversely proportional to the number of peri- 
odograms averaged, and as K increases, the variance approaches zero. 

From Eq. (10.74), we see that as L, the length of the segment x r [n], increases, 
the main lobe of C ww (e )( °) decreases in width, and consequently, from Eq. (10.72), 
£{I(co)} more closely approximates P xx (co). However, for fixed total data length Q, 
the total number of segments (assuming that L = R) is Ql L\ therefore, as L increases, 
K decreases. Correspondingly, from Eq. (10.76), the variance of l(w) will increase. Thus, 
as is typical in statistical estimation problems, for a fixed data length there is a trade-off 
between bias and variance. However, as the data length Q increases, both L and K 
can be allowed to increase, so that as Q approaches oo, the bias and variance of I(co) 
can approach zero. Consequently, periodogram averaging provides an asymptotically 
unbiased, consistent estimate of P xx (w). 

The preceding discussion assumed that nonoverlapping rectangular windows were 
used in computing the time-dependent periodograms. Welch (1970) showed that if a 
different window shape is used, the variance of the average periodogram still behaves 
as in Eq. (10.76). Welch also considered the case of overlapping windows and showed 
that if the overlap is one-half the window length, the variance is further reduced by 
almost a factor of 2, due to the doubling of the number of sections. Greater overlap 
does not continue to reduce the variance, because the segments become less and less 
independent as the overlap increases. 
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1 0.6.4 Computation of Average Periodo grams Using 
the DFT 

As with the periodogram, the average periodogram can be explicitly evaluated only at 
a discrete set of frequencies. Because of the availability of the fast Fourier transform 
algorithms for computing the DFT, a particularly convenient and widely used choice is 
the set of frequencies (o k = 2tt/://V for an appropriate choice of N. From Eq. (10.69), we 
see that if the DFT of x r [n] is substituted for the Fourier transform of x r [n] in Eq. (10.68), 
we obtain samples of I(co) at the DFT frequencies co k = 2tt k/N for k = 0, 1, . . . , N — 1. 
Specifically, with X r [k] denoting the DFT of x r [n], 

Ir[k] = I r (oj k ) = -^j\Xr[k]\\ (10.77a) 

1 * _1 
/[*] = /(a*) = 7p $>[*]. (10.77b) 

We denote I r (2nk/N) as the sequence I r [k] and I(2jrk/N) as the sequence I[k]. 
According to Eqs. ( 1 0.77a) and ( 1 0.77b), the average periodogram estimate of the power 
spectrum is computed at jV equally spaced frequencies by averaging the DFTs of the 
windowed data segments with the normalizing factor LU. This method of power spec- 
trum estimation provides a very convenient framework within which to trade between 
resolution and variance of the spectral estimate. It is particularly simple and efficient 
to implement using the fast Fourier transform algorithms discussed in Chapter 9. An 
important advantage of the method over those to be discussed in Section 10.7 is that 
the spectrum estimate is always nonnegative. 

10.6.5 An Example of Periodogram Analysis 

Power spectrum analysis is a valuable tool for modeling signals, and it also can be used 
to detect signals, particularly when it comes to finding hidden periodicities in sampled 
signals. As an example of this type of application of the average periodogram method, 
consider the sequence 

x[n] = Acos(co n + 0) + e[n], (10.78) 

where is a random variable uniformly distributed between and 2tt and e[n] is a zero- 
mean white-noise sequence that has a constant power spectrum; i.e., P ee (co) = of for all 
to. In signal models of this form, the cosine is generally the desired component and e[n] 
is an undesired noise component. Often, in practical signal detection problems we are 
interested in the case for which the power in the cosine signal is small compared with 
the noise power. It can be shown (see Problem 10.34) that over one period in frequency, 
the power spectrum for this signal is 

A 2 7T 

P xx (co) = -—-{8(to - coo) + S(to + co )] + a] for M < n. (10.79) 

From Eqs. (10.72) and (10.79), it follows that the expected value of the average peri- 
odogram is 

SU(co)} = ^[C ww (^ (w - W «)) + C ww {e^^)]+al (10.80) 
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Figure 10.22 Cosine sequence with 
white noise, as in Eq. (10.78). 



Figures 10.22 and 10.23 show the use of the averaging method for a signal of the form 
of Eq. (10.78), with A — 0.5, wo = 2^/21, and random phase < 6 < 27r.The noise was 
uniformly distributed in amplitude such that — V5 < e[n] < \/3. Therefore, it is easily 
shown that aj = 1 . The mean of the noise component is zero. Figure 10.22 shows 101 
samples of the sequence x[n]. Since the noise component e[n] has maximum amplitude 
>/3, the cosine component in the sequence x[n] is not visually apparent. 

Figure 10.23 shows average periodogram estimates of the power spectrum for 
rectangular windows with amplitude 1 , so that U = 1, and of lengths L = 1024, 256, 64, 
and 16, with the total record length Q = 1024 in all cases. Except for Figure 10.23(a), 
the windows overlap by one-half the window length. Figure 10.23(a) is the periodogram 
of the entire record, and Figures 10.23(b), (c), and (d) show the average periodogram 
for K = 7, 31, and 127 segments, respectively. In all cases, the average periodogram was 
evaluated using 1024-point DFTs at frequencies o>a = 2nk/l024. (For window lengths 
L < 1024, we must pad the windowed sequence with zero-samples before computing 
the DFT.) Therefore, the frequency a>o = 2tt/21 lies between DFT frequencies co^ = 
2tt48/1024 and qj 49 = 2^-49/1024. 

In using such estimates of the power spectrum to detect the presence and/or 
the frequency of the cosine component, we might search for the highest peaks in the 
spectral estimate and compare their size with that of the surrounding spectral values. 
From Eqs. (10.74) and (10.80), the expected value of the average periodogram at the 
frequency ojq is 

A 2 L 



£{I(co )} = 



+ °: 



(10.81) 



Thus, if the peak due to the cosine component is to stand out against the variability of the 
average periodogram, then in this special case we must choose L so that A 2 L/4 ^> a}. 
This is illustrated by Figure 10.23(a), where L is as large as it can be for the record length 
Q. We see that L — 1024 gives a very narrow main lobe of the Fourier transform of 
the autocorrelation of the rectangular window, so it would be possible to resolve very 
closely spaced sinusoidal signals. Note that for the parameters of this example (A = 0.5, 
o 2 = 1) and with L = 1024, the peak amplitude in the periodogram at frequency 2jt/21 
is close, but not equal, to the expected value of 65. We also observe additional peaks 
in the periodogram with amplitudes greater than 10. Clearly, if the cosine amplitude 
A had been smaller by only a factor of 2, it is possible that its peak would have been 
confused with the inherent variability of the periodogram. 
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We have seen that the only sure way to reduce the variance of the spectrum esti- 
mate is to increase the record length of the signal. This is not always possible, and even 
if it is possible, longer records require more processing. We can reduce the variability 
of the estimate while keeping the record length constant if we use shorter windows 
and average over more sections. The cost of doing this is illustrated by parts (b), (c), 
and (d) of Figure 10.23. Note that as more sections are used, the variance of the spec- 
tral estimate decreases, but in accordance with Eq. (10.81), so does the amplitude of 
the peak due to the cosine. Thus, we again face a trade-off. That the shorter windows 
reduce variability is clear, especially if we compare the high-frequency regions away 
from the peak in parts (a), (b) and (c) of Figure 10.23. Recall that the idealized power 
spectrum of the model for the pseudorandom-noise generator is a constant (<j ( ? = 1) 
for all frequencies. In Figure 10.23(a) there are peaks as high as about 10 when the true 
spectrum is 1. In Figure 10.23(b) the variation away from 1 is less than about 3, and in 
Figure 10.23(c) the variation around 1 is less than .5. However, shorter windows also 
reduce the peak amplitude of any narrowband component, and they also degrade our 
ability to resolve closely spaced sinusoids. This reduction in peak amplitude is also clear 
from Figure 10.23. Again, if we were to reduce A by a factor of 2 in Figure 10.23(b), 
the peak height would be approximately 4, which is not much different from many of 
the other peaks in the high-frequency region. In Figure 10.23(c) a reduction of Aby a 
factor of 2 would make the peak approximately 1.25, which would be indistinguishable 
from the other ripples in the estimate. In Figure 10.23(d) the window is very short, 
and thus the fluctuations of the spectrum estimate are greatly reduced, but the spectral 
peak due to the cosine is very broad and barely above the noise even for A = .5. If 
the length were any smaller, spectral leakage from the negative-frequency component 
would cause there to be no distinct peak in the low-frequency region. 

This example confirms that the average periodogram provides a straightforward 
method of trading off between spectral resolution and reduction of the variance of the 
spectral estimate. Although the theme of the example was the detection of a sinusoid 
in noise, the average periodogram could also be used in signal modeling. The spectral 
estimates of Figure 10.23 clearly suggest a signal model of the form of Eq. (10.78), and 
most of the parameters of the model could be estimated from the average periodogram 
power spectrum estimate. 
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f 0.7 SPECTRUM ANALYSIS OF RANDOM SIGNALS USING 
ESTIMATES OF THE AUTOCORRELATION 
SEQUENCE 

In the previous section, we considered the periodogram as a direct estimate of the 
power spectrum of a random signal. The periodogram or the average periodogram is 
a direct estimate in the sense that it is obtained directly by Fourier transformation of 
the samples of the random signal. Another approach, based on the fact that the power 
density spectrum is the Fourier transform of the autocorrelation function, is to first 
estimate the autocorrelation function <p xx [m\ and then compute the Fourier transform 
of this estimate. In this section, we explore some of the important facets of this approach 
and show how the DFT can be used to implement it. 

Let us assume, as before, that we are given a finite record of a random signal x[n\. 
This sequence is denoted 

ri_/-*M for0<rt<(?-l, (\C\K1\ 

L J — 1 otherwise. ^ 

Consider an estimate of the autocorrelation sequence as 

4x X \m] = -c vl \ml (10.83) 



where, since c vv [—m] = c llL ,[m], 
Q 



Q-\m\-\ 



r i V^ r i r , i J Y^ *[«]■*[>!+ |m|], \m\ < Q - U 
" =0 I otherwise, 



(10.84) 



corresponding to the aperiodic correlation of a rectangularly windowed segment of x[n]. 
To determine the properties of this estimate of the autocorrelation sequence, we 
consider the mean and variance of the random variable <p xx [m\. From Eqs. (10.83) and 
(10.84), it follows that 



Q-\m\-\ , Q-\m\-\ 



S[4> xx [m]) = - Y, £{x[n]x[n + ]m\]} = - ]T 0,. r [m], (10.85) 



and since <p xx [m\ does not depend on n for a stationary random process, 

^>ll = ((^)*" H WSG-1, (10 . 86) 

\ otherwise. 

From Eq. (10.86), we see that <fr xx [m\ is a biased estimate of <j> xx [m\, since E{4> xx [m]} 
is not equal to <p xx [m], but the bias is small if \m\ <§; Q. We see also that an unbiased 
estimator of the autocorrelation sequence for \m\ < Q — 1 is 

***M = ( ttVt) c »'H; (io.87) 

\Q-\m\J 

i.e., the estimator is unbiased if we divide by the number of nonzero terms in the sum 
of lagged products rather than by the total number of samples in the data record. 
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The variance of the autocorrelation function estimates is difficult to compute, even 
with simplifying assumptions- However, approximate formulas for the variance of both 
4> xx [iri\ and <$> xx [m\ can be found in Jenkins and Watts (1968). For our purposes here, it is 
sufficient to observe from Eq. (10.84) that as \m\ approaches Q, fewer and fewer samples 
of x[n] are involved in the computation of the autocorrelation estimate, and therefore, 
the variance of the autocorrelation estimate can be expected to increase with increasing 
\m\. In the case of the periodogram, this increased variance affects the spectrum estimate 
at all frequencies because all the autocorrelation lag values are implicitly involved in the 
computation of the periodogram. However, by explicitly computing the autocorrelation 
estimate, we are free to choose which correlation lag values to include in estimating the 
power spectrum. Thus, we define the power spectrum estimate 

S{co)= Yl $xx[m]w c [m]e- i(om , (10.88) 

m = -(Af-l) 

where w c [m] is a symmetric window of length (2M - 1) applied to the estimated auto- 
correlation function. We require that the product of the autocorrelation sequence and 
the window be an even sequence when x[n] is real, so that the power spectrum estimate 
will be a real even function of to. Therefore, the correlation window must be an even 
sequence. By limiting the length of the correlation window so that M <$; Q, we include 
only autocorrelation estimates for which the variance is low. 

The mechanism by which windowing the autocorrelation sequence reduces the 
variance of the power spectrum estimate is best understood in the frequency domain. 
From Eqs. (10.53), (10.54), and (10.84), it follows that, with w[n] = 1 for < n < 
(Q - 1), i.e., a rectangular window, the periodogram is the Fourier transform of the 
autocorrelation estimate 4> xx [m]\ i.e., 

ixxlm] = ~c ull [m] <£+ i|VV' w )l 2 = /(")■ (10-89) 

Therefore, from Eq. (10.88), the spectrum estimate obtained by windowing of 4> xx [m] 
is the convolution 

S(w) = - 1 - r I(0)W c (e J{aJ - o) )d0. (10.90) 

From Eq. (10.90), we see that the effect of applying the window w c [m] to the auto- 
correlation estimate is to convolve the periodogram with the Fourier transform of the 
autocorrelation window. This will smooth the rapid fluctuations of the periodogram 
spectrum estimate. The shorter the correlation window, the smoother will be the spec- 
trum estimate, and vice versa. 

The power spectrum P xx (co) is a nonnegative function of frequency, and the peri- 
odogram and the average periodogram automatically have this property by definition. 
In contrast, from Eq. (10,90), it is evident that nonnegativity is not guaranteed for S(co), 
unless we impose the further condition that 

W c (e j( °) > for - n < co < n. (10.91) 

This condition is satisfied by the Fourier transform of the triangular (Bartlett) win- 
dow, but it is not satisfied by the rectangular, Hanning, Hamming, or Kaiser windows. 
Therefore, although these latter windows have smaller side lobes than the triangular 
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window, spectral leakage may cause negative spectral estimates in low-level regions of 
the spectrum. 

The expected value of the smoothed periodogram is 

M-\ 

E[S(a>)} = £ Ei4> xx [m]}wc[m]e-' a,m 

m=-(M-i) 

M_1 m-\m\\ 

,—jcom 



\T a. r i ( Q-\ m \ \ r i - 



m=-(Af-l) 

If Q ys> M, the term (Q — |wi|)/Q in Eq. (10.92) can be neglected, 6 so we obtain 

M-\ , „„ 

E{S(a>)} = V 4> xx [m]w c [m]e->' tt,m = — / P xx (6)W c [e^-^]d9. (10.93) 

^ — Lit \- 

m=-(M-l) J n 

Thus, the windowed autocorrelation estimate leads to a biased estimate of the power 
spectrum, Just as with the average periodogram. it is possible to trade spectral resolution 
for reduced variance of the spectrum estimate. If the length of the data record is fixed, we 
can have lower variance if we are willing to accept poorer resolution of closely spaced 
narrowband spectral components, or we can have better resolution if we can accept 
higher variance. If we are free to observe the signal for a longer time (i.e., increase 
the length Q of the data record), then both the resolution and the variance can be 
improved. The spectrum estimate S(co) is asymptotically unbiased if the correlation 
window is normalized so that 

~- f W c (e iw )dco = 1 = w c [0]. (10.94) 

With this normalization, as we increase Q together with the length of the correlation 
window, the Fourier transform of the correlation window approaches a periodic impulse 
train and the convolution of Eq. (10.93) duplicates P xx (co). 

The variance of S(co) has been shown (see Jenkins and Watts, 1968) to be of the 
form 



var[5H] - [ i JT w 2 c [m\ P 2 xx {a>). (10,95) 

Comparing Eq. (10.95) with the corresponding result in Eq. (10.65) for the periodogram 
leads to the conclusion that, to reduce the variance of the spectrum estimate, we should 
choose M and the window shape, possibly subject to the condition of Eq. (10.91), so 
that the factor 

\* m=-{M-\) / 

is as small as possible. Problem 10.29 deals with the computation of this variance reduc- 
tion factor for several commonly used windows. 

6 More precisely, we could define an effective correlation window iv e [wi] = Wc ["*]((? — \m\)/Q. 
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Estimation of the power spectrum based on the Fourier transform of an estimate 
of the autocorrelation function is a clear alternative to the method of averaging peri- 
odograms. It is not necessarily better in any general sense; it simply has different features 
and its implementation would be different. In some situations it may be desirable to 
compute estimates of both the autocorrelation sequence and the power spectrum, in 
which case it would be natural to use the method of this section. Problem 10.37 explores 
the issue of determining an autocorrelation estimate from the average periodogram. 

f 0.7.1 Computing Correlation and Power Spectrum Estimates 
Using the DFT 

The autocorrelation estimate 

j Q-\m\-l 

6r,M=0 E x[n]x[n + \m\] (10.97) 

is required for \m\ < M — 1 in the method of power spectrum estimation that we are 
considering. Since 4> xx [—m\ = 4> xx [tn\, it is necessary to compute Eq. (10.97) only for 
nonnegative values of m, i.e., for < m < M — 1. The DFT and its associated fast 
computational algorithms can be used to advantage in the computation oi$ xx [m\ if we 
observe that 4> xx [m] is the aperiodic discrete convolution of the finite-length sequence 
x[n] with x[— n]. If we compute X[k] y the Appoint DFT of x[n], and multiply by A^*[/:], 
we obtain |X[/:]| 2 , which corresponds to the circular convolution of the finite-length 
sequence x[n] with x[((— «))#], i.e., a circular autocorrelation. As our discussion in 
Section 8.7 suggests, and as developed in Problem 10.27, it should be possible to augment 
the sequence x[n] with zero-valued samples and force the circular autocorrelation to 
be equal to the desired aperiodic autocorrelation over the interval < m < M — 1. 

To see how to choose A" for the DFT, consider Figure 10.24. Figure 10.24(a) shows 
the two sequences x[n] and x[n + m] as functions of n for a particular positive value of 
m. Figure 10.24(b) shows the sequences x[n] and x[((n + m)) N ] that are involved in the 
circular autocorrelation corresponding to |^[/c]| 2 . Clearly, the circular autocorrelation 
will be equal to Q$ xx [m] for < m < M — 1 if x[((n + m)) N ] does not wrap around and 
overlap x[n] when < m < M — 1. From Figure 10.24(b), it follows that this will be the 
case whenever N ~ (M — 1) > Qor N > Q+ M — 1. 

In summary, we can compute $ xx [m] for 5 m < M—l by the following procedure: 

1. Form an Appoint sequence by augmenting x[n] with (M — 1) zero-samples. 

2. Compute the A-point DFT, 

jV-1 

X[k] = J2 x[n]e-i {2n/N)kn for k = 0, 1, . . . , N - 1. 

3. Compute 

\X[k]\ 2 = X[k]X*[k] for* = 0, 1,..., JV-1. 

4. Compute the inverse DFT of lA^&JI 2 to obtain 

1 * -1 
c vv [m] = - Yl )X[k]\ 2 e j{lnlN)km for m = 0, 1, . . . , JV - 1. 
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5. Divide the resulting sequence by Q to obtain the autocorrelation estimate 



1 
0«M = -QC vv [m] 



for/n = 0, 1, ..., M-l. 



This is the desired set of autocorrelation values, which can be extended symmet- 
rically for negative values of m. 

If M is small, it may be more efficient simply to evaluate Eq. (10.97) directly. In 
this case, the amount of computation is proportional to Q ■ M. In contrast, if the DFTs 
in this procedure are computed using one of the FFT algorithms discussed in Chapter 9 
with N > Q -f M — 1, the amount of computation will be approximately proportional to 
jVlog 2 NforNa power of 2. Consequently, for sufficiently large values of M, use of the 
FFT is more efficient than direct evaluation of Eq. (10.97). The exact break-even value 
of M will depend on the particular implementation of the DFT computations; however, 
as shown by Stockham (1966), this value would probably be less than M — 100. 

We should remember that in order to reduce the variance of the estimate of the 
autocorrelation sequence or the power spectrum estimated from it, we must use large 
values of the record length Q. In such cases, it may be inconvenient or impossible to 
efficiently compute the (N = Q + M — l)-point DFTs called for by the procedure just 
outlined. However, M is generally much less than Q. In such cases, it is possible to 
section the sequence x[n] in a manner similar to the procedures that were discussed in 
Section 8.7.3 for convolution of a finite-length impulse response with an indefinitely long 
input sequence. Rader (1970) presented a particularly efficient and flexible procedure 
that uses many of the properties of the DFT of real sequences to reduce the amount of 
computation required. The development of this technique is the basis for Problem 10.38. 

Once the autocorrelation estimate has been computed, samples of the power 
spectrum estimate S(co) can be computed at frequencies cok = 27tk/N by forming the 
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finite-length sequence 

( $ xx [m]w c [m], <m < M — 1, 

s[m] = \o, M<m< N- M, (10.98) 

where w c [m] is the symmetric correlation window. Then the DFT of s[m] is 

S[k] = S(co)L =2 nk/N, k = 0, 1, . . . , N - 1, (10.99) 

where S(a>) is the Fourier transform of the windowed autocorrelation sequence as de- 
fined by Eq. (10.88). Note that N can be chosen as large as is convenient and practical, 
thereby providing samples of S(co) at closely spaced frequencies. However, the fre- 
quency resolution is always determined by the length and shape of the window w c [m]. 



10.7.2 An Example of Power Spectrum Estimation Based on 
Estimation of the Autocorrelation Sequence 

In Chapter 4, we assumed that the error introduced by quantization is a white-noise 
random process. We can use the techniques of this section to illustrate the validity of 
this assumption by estimating the autocorrelation sequence and power spectrum of 
quantization noise. 

Consider the experiment depicted in Figure 10.25. A lowpass-filtered speech sig- 
nal x c (t) was sampled at a 10-KHz rate, yielding a sequence of samples x[n]. (Although 
the samples were quantized to 12 bits by the A/D converter, for purposes of this ex- 
periment we assume that the samples are unquantized.) The samples were rescaled so 
that \x[n]\ < 16,000. These samples were first quantized with an 8-bit linear quantizer, 
and the corresponding error sequence e[n] = Q[x[n]] — x[n] was computed as shown in 
Figure 10.25. Figure 10.26(a) shows 400 consecutive samples of the speech signal, and 
Figure 10.26(b) shows the corresponding error sequence. (The samples are connected 
with straight lines for convenience in plotting.) Visual inspection and comparison of 
these two plots tends to strengthen our belief in the previously assumed model; how- 
ever, the flatness of the quantization noise spectrum can be verified only by estimating 
the power spectrum of the quantization noise e[n\. 

Figure 10.27 shows estimates of the normalized autocorrelation and power spec- 
trum of the quantization noise for a record length of Q = 2000 samples. The mean of the 
noise sequence e[n] was estimated and subtracted before the autocorrelation sequence 
estimate was calculated for M = 512. The resulting autocorrelation estimate was divided 
by ee [O] to obtain the normalized estimate p ee [m] = <i>ee[ m ]/4>ee[Q]> which is plotted in 
Figures 10.27(a) and (c). Note that the normalized autocorrelation is 1.0 at m = and 
much smaller elsewhere. Indeed, -0.0548 < p xx [m] ^ 0.0579 for 1 < m < 512. This 
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Figure 10.25 Procedure for obtaining 
quantization noise sequence. 
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Figure 10.26 (a) Speech waveform and (b) the corresponding quantization error 
for 8-bit quantization (magnified 66 times with respect to part a). Each line corre- 
sponds to 100 consecutive samples connected by straight lines for convenience in 
plotting. 
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Figure 10.27 (a) Normalized 
autocorrelation estimate for 8-bit 
quantization noise; record length 
Q = 2000. (b) Power spectrum 
estimate using Bartlett window with 
M = 512. (c) Normalized 
autocorrelation estimate, < m < 50. 
(d) Power spectrum estimate using 
Bartlett window with M = 50. 



seems to support our assumption that the error sequence is uncorrelated from sample 
to sample. 

The power spectrum of the noise was estimated by windowing the normalized 
autocorrelation with a Bartlett window, as discussed in Section 10.7.1, and with M = 512. 
The result, depicted in Figure 10.27(b), plotted in dB, shows rather erratic fluctuations 
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about dB (the value of the normalized power spectrum of white noise). A smoother 
estimate is shown in Figure 10.27(d). In this case, a Bartlett window with M — 50 was 
used. The resulting smoothing, corresponding to a loss of resolution, is quite evident in 
comparing Figure 10.27(b) with Figure 10.27(d). We see from Figure 10.27(d) that the 
spectrum estimate is between -1.097 dB and +1.631 dB for all frequencies. Thus, we 
are again encouraged to believe that the white-noise model is appropriate for this case 
of quantization. 

Although we have computed quantitative estimates of the autocorrelation and the 
power spectrum, our interpretation of these measurements has been only qualitative. 
It is reasonable now to ask how small the autocorrelation would be if e[n] were really a 
white-noise process? To give quantitative answers to such questions, confidence inter- 
vals for our estimates could be computed and statistical decision theory applied. (See 
Jenkins and Watts, 1968, for some tests for white noise.) In many cases, however, this 
additional statistical treatment is not necessary. In a practical setting, we are often com- 
fortable and content simply with the observation that the normalized autocorrelation 
is very small everywhere, except at m = 0. 

One of the most important insights of this chapter is that the estimate of the 
autocorrelation and power spectrum of a stationary random process should improve if 
the record length is increased. This is illustrated by Figure 10.28, which corresponds to 
Figure 10.27, except that Q\s increased to 14.000 samples. Recall that the variance of the 
autocorrelation estimate is proportional to l/Q. Thus, increasing Qfrom 2000 to 14,000 
should bring about a sevenfold reduction in the variance of the estimate. A comparison 
of Figures 10.27(a) and 10.28(a) seems to verify this result. For Q = 2000, the estimate 
falls between the limits -0.0548 and +0.0579, while for Q = 14,000, the limits are 
—0.0254 and +0.0231. Comparing the range of variation for Q = 2000 with the range 
for Q = 14,000 indicates that the reduction is consistent with the sevenfold reduction 
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Figure 10.28 (a) Normalized 
autocorrelation estimate for 8-bit 
quantization noise; record length 
Q = 14, 000. (b) Power spectrum 
estimate using Bartlett window with 
W = 512. 
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Figure 10.28 {continued) 
(c) Normalized autocorrelation estimate, 
< m < 50, (d) Power spectrum 
estimate using Bartlett window with 
M = 50. 
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Figure 10.29 Quantization error 
waveform for 3-bit quantization. (Same 
scale as original signal, which is shown 
in Figure 10.26(a).) 



in variance that we expected. 7 We note from Eq. (10.96) that a similar reduction in 
variance of the spectrum estimate is also expected. This is again evident in comparing 
Figures 10.27(b) and (d) with Figures 10.28(b) and (d), respectively. (Be sure to note 
that the scales are different between the two sets of plots.) 

In Chapter 4 we argued that the white-noise model was reasonable, as long as the 
quantization step size was small. When the number of bits is small, this condition does not 
hold. To see the effect on the quantization noise spectrum, the previous experiment was 
repeated using only 8 quantization levels, or 3 bits. Figure 10.29 shows the quantization 
error for 3-bit quantization of the speech waveform segment shown in Figure 10.26(a). 
Note that portions of the error waveform tend to look very much like the original speech 
waveform. We would expect this to be reflected in the estimate of the power spectrum. 



7 RecaIl that a reduction in variance by a factor of 7 corresponds to a reduction in amplitude by a factor 
of V7 % 2.65. 
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Figure 10.30 shows the autocorrelation and power spectrum estimates of the error 
sequence for 3-bit quantization for a record length of 14,000 samples. In this case, the 
autocorrelation shown in Figures 10.30 (a) and 10.30 (c) is much less like the ideal 
autocorrelation for white noise. 
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Figure 10.30 (a) Normalized 
autocorrelation estimate for 3-bit 
quantization noise; record length 
Q = 14,000. (b) Power spectrum 
estimate using Bartlett window with 
M = 512. (c) Normalized 
autocorrelation estimate, < m < 50. 
(d) Power spectrum estimate using 
Bartlett window with M = 50. 
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Figures 10.30 (b) and (d) show the power spectrum estimates for Bartlett windows 
with M = 512 and M = 50, respectively. Clearly, the spectrum is not flat. (In fact, it 
tends to have the general shape of the speech spectrum.) Thus, the white-noise model 
for quantization noise can be viewed only as a rather crude approximation in this case. 

This example illustrates how autocorrelation and power spectrum estimates are 
often used to bolster our confidence in theoretical models. Specifically, we have demon- 
strated the validity of some of our basic assumptions in Chapter 4, and we have given 
an indication of how these assumptions break down for very crude quantization. This is 
only a rather simple, but useful, example of how the techniques of the current chapter 
are often applied in practice. 



10.8 SUMMARY 

One of the important applications of signal processing is the spectral analysis of signals. 
Because of the computational efficiency of the FFT, many of the techniques for spectral 
analysis of continuous-time or discrete-time signals utilize the DFT either directly or 
indirectly. In this chapter, we explored and illustrated some of these techniques. 

Many of the issues associated with spectral analysis are best understood in the con- 
text of the analysis of sinusoidal signals. Since the use of the DFT requires finite-length 
signals, windowing must be applied in advance of the analysis. For sinusoidal signals, 
the width of the spectral peak observed in the DFT is dependent on the window length, 
with an increasing window length resulting in the sharpening of the peak. Consequently, 
the ability to resolve closely spaced sinusoids in the spectral estimate decreases as the 
window becomes shorter. A second, independent effect inherent in spectral analysis 
using the DFT is the associated spectral sampling. Specifically, since the spectrum can 
be computed only at a set of sample frequencies, the observed spectrum can be mis- 
leading if we are not careful in its interpretation. For example, important features in 
the spectrum may not be directly evident in the sampled spectrum. To avoid this, the 
spectral sample spacing can be reduced by increasing the DFT size in one of two ways. 
One method is to increase the DFT size while keeping the window length fixed (requir- 
ing zero-padding of the windowed sequence). This does not increase resolution. The 
second method is to increase both the window length and the DFT size. In this case 
spectral sample spacing is decreased and the ability to resolve closely spaced sinusoidal 
components is increased. 

While increased window length and resolution are typically beneficial in the 
spectral analysis of stationary data, for time-varying data it is generally preferable 
to keep the window length sufficiently short so that over the window duration, the 
signal characteristics are approximately stationary. This leads to the concept of the 
time-dependent Fourier transform, which, in effect, is a sequence of Fourier transforms 
obtained as the signal slides past a finite -duration window. A common and useful in- 
terpretation of the time-dependent Fourier transform is as a bank of filters, with the 
frequency response of each filter corresponding to the transform of the window, fre- 
quency shifted to one of the DFT frequencies. The time-dependent Fourier transform 
has important applications both as an intermediate step in filtering signals and for 
analyzing and interpreting time-varying signals such as speech and radar signals. Spec- 
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tral analysis of nonstationary signals typically involves a trade-off between time and 
frequency resolution. Specifically, our ability to track spectral characteristics in time 
increases as the length of the analysis window decreases. However, a shorter analysis 
window results in decreased frequency resolution. 

The DFT also plays an important role in the analysis of stationary random sig- 
nals. An intuitive approach to estimating the power spectrum of random signals is to 
compute the squared magnitude of the DFT of a segment of the signal. The result- 
ing estimate, called the periodogram, is asymptotically unbiased. The variance of the 
periodogram estimate, however, does not decrease to zero as the length of the seg- 
ment increases, and consequently, the periodogram is not a good estimate. However, 
by dividing the available signal sequence into shorter segments and averaging the asso- 
ciated periodograms, we can obtain a well-behaved estimate. An alternative approach 
is to first estimate the autocorrelation function. This can be done either directly or 
with the DFT. If a window is then applied to the autocorrelation estimates followed 
by the DFT, the result, referred to as the smoothed periodogram, is a good spectral 
estimate. 



PROBLEMS 



Basic Problems with Answers 

10.1. A real continuous-time signal x c (t) is bandlimited to frequencies below 5 kHz; i.e., 
X c (jQ) = for \Q\ > 2^(5000). The signal x c (t) is sampled with a sampling rate of 
10,000 samples per second (10 kHz) to produce a sequence x[n] — x c (nT) with T = 10 -4 . 
Let X[k] be the 1000-point DFT of x[n]. 

(a) To what continuous-time frequency does the index k = 150 in X[k] correspond? 

(b) To what continuous-time frequency does the index k = 800 in X[k] correspond? 

10.2. A continuous-time signal x c (t) is bandlimited to 5 kHz; i.e., X c (jQ) = for \Q\ > 
2jt(5000). x c (t) is sampled with period 7, producing the sequence x[n] = x c (nT). To 
examine the spectral properties of the signal, we compute the Appoint DFT of a segment 
of /V samples of x[n] using a computer program that requires N = 2 V , where v is an integer. 
Determine the minimum value for TV and the range of sampling rates 

1 

* min < ~ < r max 

such that aliasing is avoided and the effective spacing between DFT values is less than 
5 Hz; i.e., the equivalent continuous-time frequencies at which the Fourier transform is 
evaluated are separated by less than 5 Hz. 

10.3. A speech signal is sampled with a sampling rate of 16,000 samples/s (16 kHz). A window 
of 20-ms duration is used in time-dependent Fourier analysis of the signal, as described 
in Section 10.3, with the window being advanced by 40 samples between computations of 
the DFT. Assume that the length of each DFT is TV = 2 V . 

(a) How many samples are there in each segment of speech selected by the window? 

(b) What is the "frame rate" of the time-dependent Fourier analysis; i.e., how many DFT 
computations are done per second of input signal? 
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(c) What is the minimum size jV of the DFT such that the original input signal can be 
reconstructed from the time-dependent Fourier transform? 

(d) What is the spacing (in Hz) between the DFT samples for the minimum N from 
Part (c)? 

10.4. A real- valued continuous-time segment of a signal x c (t) is sampled at a rate of 20,000 
samples/sec, yielding a 1000-point finite-length discrete-time sequence x[n] that is nonzero 
in the interval < n < 999. It is known that x c (t) is also bandlimited such that X c (jQ) = 
for \Q\ > 27r(10,000); i.e., assume that the sampling operation does not introduce any 
distortion due to aliasing. 

X[k] denotes the 1000-point DFT of x[n]. A' [800] is known to have the value 
^[800] = 1 + y. 

(a) From the information given, can you determine X[k] at any other values of kl If so, 
state which value(s) of k and what the corresponding value of X[k] is. If not, explain 
why not. 

(b) From the information given, state the value(s) of £2 for which X c (jQ) is known and 
the corresponding value(s) of X c (jQ). 

10.5. A continuous-time signal x c (t) = cos(QqI) is sampled with period T to produce the se- 
quence x[n] =■ x c (nT). An /V-point rectangular window is applied to x[n] for 0, 1 N— 1, 

and X[k], for k = 0, 1 N - 1 , is the TV-point DFT of the resulting sequence. 

(a) Assuming that ^o, jV, and /cq are fixed, how should T be chosen so that X[ko] and 
X[N - ko] are nonzero and X[k] = for all other values of/:? 

(b) Is your answer unique? If not, give another value of T that satisfies the conditions of 
Part (a). 

10.6. Let x c (t) be a real-valued, bandlimited signal whose Fourier transform X c (jQ) is zero for 
\Q\ > 2k(5O00). The sequence x[n] is obtained by sampling x c •(/) at 10 kHz. Assume that 
the sequence x[n] is zero for n < and n > 999. 

Let X[k] denote the 1000-point DFT of x[n\. It is known that ,¥[900] = 1 and 
A^[420] = 5 . Determine X c (j£2) for as many values of Q as you can in the region \Q\ < 
2^(5000). 

10.7. Consider estimating the spectrum of a discrete-time signal x[n] using the DFT with a 
Hamming window for w[n\. A conservative rule of thumb for the frequency resolution of 
windowed DFT analysis is that the frequency resolution is equal to the width of the main 
lobe of W(e ,a) ). You wish to be able to resolve sinusoidal signals that are separated by as 
little as jt/100 in a). In addition, your window length L is constrained to be a power of 2. 
What is the minimum length L = 2 V that will meet your resolution requirement? 

10.8. Let x[n] be a discrete-time signal whose spectrum you wish to estimate using a windowed 
DFT. You are required to obtain a frequency resolution of at least tt/25 and are also 
required to use a window length N = 256. A safe estimate of the frequency resolution of 
a spectral estimate is the main-lobe width of the window used. Which of the windows in 
Table 7.1 will satisfy the criteria given for frequency resolution? 

10.9. The following are three different signals x\[n] that are the sum of two sinusoids: 

X\ [n] = cos (jz «/4) + cos (177T n/64) , 
x 2 [n] = cos(jrrt/4) + 0.8cos(21;rH/64), 
x 3 [n] = cos (jr«/4) + 0.001 cos (21 jr n/64). 

We wish to estimate the spectrum of each of these signals using a 64-point DFT with a 
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64-point rectangular window w[n\. Indicate which of the signals' 64-point DFTs you would 
expect to have two distinct spectral peaks after windowing. 

10.10. Let x[n] be a discrete-time signal obtained by sampling a continuous-time signal x c (t) with 
some sampling period Tso that x[n] = x c (nT). Assume x c (t) isbandlimited to 100 Hz, i.e, 
X c (jQ) = Ofor \Q[ > 27r(100). We wish to estimate the continuous-time spectrum X c (jQ) 
by computing a 1024-point DFT of x[n], X[k]. What is the smallest value of Tsuch that 
the equivalent frequency spacing between consecutive DFT samples X [k] corresponds to 
1 Hz or less in continuous-time frequency? 

10.11. Let x[n] be a 5000-point sequence obtained by sampling a continuous-time signal x ( (t) at 
T — 50 /is. Suppose X[k] is the 8192-point DFT of x[n]. What is the equivalent frequency 
spacing in continuous time of adjacent DFT samples? 

10.12. Assume that x[n] is a 1000-point sequence obtained by sampling a continuous-time signal 
x c (t) at 8 kHz and that X c (jQ) is sufficiently bandlimited to avoid aliasing. What is the 
minimum DFT length N such that adjacent samples of X[k] correspond to a frequency 
spacing of 5 Hz or less in the original continuous-time signal? 

10.13. Let X r [k] be the time-dependent Fourier transform (TDFT) defined in Eq. (10.36). For 
this problem, consider the TDFT when both the DFT length N ~ 36 and the sampling 
interval R = 36. Let the window w[n] be a rectangular window. Compute the TDFT X r [k] 
for —oo < r < co and < /c < N — 1 for the signal 

( cos(jn7/6), < n < 35, 
x[n] = < cos(7rn/2). 36 < n < 71. 
^ 0. otherwise. 

10.14. Figure PI 0.14-1 shows the magnitude \V[k]\ of the 128-point DFT V[k] for a signal v[n], 
The signal v[n] was obtained by multiplying x[n] by a 128-point rectangular window w[n]\ 
i.e., v[n] = jc[/i]w[m]. Note that Figure P10.14-1 shows \V[k]\ only for the interval 5 
k S 64. Which of the following signals could be x[n]'? That is, which are consistent with 
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the information shown in the figure? 

= cos(jth/4) + cos (0. 26;r/?), 
= cos(jr>?/4) + (1/3) sin(jr/?/8), 
= cos(jt«/4) + (l/3)cos(;r«/8), 
= cost;r^/8) + (l/3)cos(jr/?/16), 
= (l/3)cos(jr«/4) + cos(jr«/8), 
= cos(jrn/4) + (l/3)cos(jr>i/8 + jt/3). 
10.15. Figure P??-l shows the spectrogram of a chirp signal of the form 



X[ [n] 


*2[n] 


x$[n] 


-U[n] 


-ViM 


M n ] 



x\n] = sin ( won + -Xn 2 ] 



Note that the spectrogram is a representation of the magnitude of X\n, k], as defined in 
Eq. (??), where the dark regions indicate large values of \X\n, k\\. Based on the figure, 
estimate wo and A. 
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Figure P10.15-1 

10.16. A continuous-time signal is sampled at a sampling rate of 10 kHz, and the DFT of 1024 
samples is computed. Determine the continuous-time frequency spacing between spectral 
samples. Justify your answer. 

10.17. A signal x[n] is analyzed using the time-dependent Fourier transform A^[fc], as defined 
in Eq. (10.36). Initially, the analysis is performed with an N — 128 DFT using an L = 
128-point Hamming window w[n]. The time-domain sampling of adjacent blocks is R = 
128; i.e., the windowed segments are offset by 128 samples in time. The frequency resolution 
obtained with this analysis is not sufficient, and it is desired to improve the resolution. 
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Several methods of modifying the analysis are suggested to accomplish this goal. Which 
of the following methods will improve the frequency resolution of the time-dependent 
Fourier transform X r [fe]? 

method 1: Increase N to 256 while maintaining L and R at the same values. 
method 2: Increase both jV and L to 256, while maintaining R the same. 
method 3: Decrease R to 64 while maintaining the same N and L. 
method 4: Decrease L to 64 while maintaining the same N and R. 
METHODS: Maintain N, R and L the same, but change w[ri\ to be a rectangular 
window. 

10.18. Let x\n] be a signal with a single sinusoidal component. The signal x[n] is windowed with 
an L-point Hamming window w[n] to obtain v\ [n] before computing V[(e j( °). The signal 
is then windowed with an L-point rectangular window to obtain vjin], which is used to 
compute V2(e J ' < "). Will the peaks in V?(e j( ") and V\ (e j( °) have the same height? If so, justify 
your answer. If not, which should have a larger peak. 

10.19. Assume that you wish to estimate the spectrum of x[n] by applying a Kaiser window to the 
signal before computing the DTFT. You require that the side lobe of the window be 30 dB 
below the main lobe and that the frequency resolution be jt/40. The width of the main 
lobe of the window is a safe estimate of the frequency resolution. Estimate the minimum 
window length L that will meet these requirements. 

10.20. It is desired to estimate the spectrum of x[n] by applying a 512-point Kaiser window to 
the signal before computing X(e*"'). 

(a) The requirements for the frequency resolution of the system specify that the largest 
allowable main lobe for the Kaiser window is tt/ 100. What is the best side lobe atten- 
uation expected under these constraints? 

(b) Suppose that you know that x[n] contains two sinusoidal components at least tt/50 
apart, and that the amplitude of the stronger component is 1 . Based on your answer to 
Part (a), give a threshold on the smallest value of the weaker component you would 
expect to see over the side lobe of the stronger sinusoid. 

Basic Problems 

10.21. Let x[n] — cos(27r«/5) and v[n] be the sequence obtained by applying a 32-point rectan- 
gular window to x[n] before computing V(e' 0J ). Sketch | V(e^)\ for — tt < co < tt, labeling 
the frequencies of all peaks and the first nulls on either side of the peak. In addition, label 
the amplitudes of the peaks and the strongest side lobe of each peak. 

10.22. Sketch the spectrogram obtained by using a 256-point rectangular window and 256-point 
DFTs with no overlap (R = 256) on the signal 
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x[n] = cos 
for the interval < n < 16,000. 

Advanced Problems 

10.23. Consider a real time-limited continuous-time signal x c (t) whose duration is 100 ms. Assume 
that this signal has a bandlimited Fourier transform such that X c (j&) = for |£2| > 
2tt(10, 000) rad/s; i.e., assume that aliasing is negligible. We want to compute samples of 
X c (jQ) with 5-Hz spacing over the interval < £2 < 2tt(10,000). This can be done with a 
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4000-point DFT. Specifically, we want to obtain a 4000-point sequence x[n] for which the 
4000-point DFT is related to X c (jQ) by 

X[k] = aX c (j2jz ■ 5 ■ k), k = 0, 1, . . . , 1999, 

where a is a known scale factor. Three methods are proposed to obtain a 4000-point 
sequence whose DFT gives the desired samples of X c (jQ). 

method 1: x c (t) is sampled with a sampling period T = 25 (is; i.e., we compute 
X\ [k], the DFT of the sequence 

xln] = l x c(nTl n = 0A 3999, 

1 0, otherwise. 

Since x c (t) is time limited to 100 ms, x\[n] is a finite-length sequence of length 4000 

(100ms/25/Lis). 

method 2: x c (t) is sampled with a sampling period of T = 50 fis. Since x c (t) is 

time limited to 100 ms, the resulting sequence will have only 2000 (100 ms/50 fis) 

nonzero samples; i.e., 

x c (nT), n = 0,\ 1999, 



M _ f x c (nT), n = 0, 1, . . 
2L J — |0, otherwise. 



In other words, the sequence is padded with zero-samples to create a 4000-point 
sequence for which the 4000-point DFT A^[/c] is computed. 

method 3: x L (/) is sampled with a sampling period of T = 50 /as, as in Method 2. 
The resulting 2000-point sequence is used to form the sequence x^[n] as follows: 

f x c (nT), <n < 1999, 

x 3 [n] = <^ x c ((n - 2000)7), 2000 < n < 3999, 
^ 0, otherwise. 

The 4000-point DFT X^[k\ of this sequence is computed. 

For each of the three methods, determine how each 4000-point DFT is related to X c (jQ). 
Indicate this relationship in a sketch for a "typical" Fourier transform X c (jQ). State 
explicitly which method(s) provide the desired samples of X c (jQ). 

10.24. A continuous-time finite-duration signal x c (t) is sampled at a rate of 20,000 samples/s, 
yieldinga 1 000-point finite-length sequence x[«] that is nonzero in the interval <n< 999. 
Assume for this problem that the continuous-time signal is also bandlimited such that 
X c (jQ) — for \Q\ > 2tt(10,000); i.e., assume that negligible aliasing distortion occurs 
in sampling. Assume also that a device or program is available for computing 1000-point 
DFTs and inverse DFTs. 
(a) If X[k] denotes the 1000-point DFT of the sequence x[n], how is X[k] related to 

X c (jQ)7 What is the effective continuous-time frequency spacing between DFT 

samples? 
The following procedure is proposed for obtaining an expanded view of the Fourier trans- 
form X c (jtt) in the interval \Q\ < 2tt(5000), starting with the 1000-point DFT X[k]. 

Step 1. Form the new 1000-point DFT 

( X[k], 0<*<250, 
W[k] = I 0, 251 < k < 749, 

[X[k], 750 < A < 999. 

Step 2. Compute the inverse 1000-point DFTof W[A:], obtaining w[n] for n — 0A 999. 
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Step 3. Decimate the sequence w[n] by a factor of 2 and augment the resuJt with 500 
consecutive zero samples, obtaining the sequence 

n J ~ \ 0, 500 < n < 999. 

Step 4. Compute the 1000-point DFT of _y[«], obtaining Y[k]. 

(b) The designer of this procedure asserts that 

Y[k] = aX c (j2n • 10 ■ it), k = 0, 1, . . . . 500, 

where a is a constant of proportionality. Is this assertion correct? If not, explain 
why not. 

10.25. Suppose that y[n] is the output of a linear time-invariant FIR system with input x[n]\ i.e., 

M 
Jt=0 

(a) Obtain a relationship between the time-dependent Fourier transform Y[n, X) of the 
output of the linear system and the time-dependent Fourier transform X[n,k) of 
the input. 

(b) Show that if the window is long compared to A/, then 

Y[n,k)- H{e> x )X[n,k), 
where H{e }M ) is the frequency response of the linear system. 

10.26. The periodogram I(oj) of a discrete-time random signal x[n] was defined in Eq. (10.52) as 

where V(e^) is the discrete-time Fourier transform of the finite-length sequence v [n] = 
w[n]x[n], with w[n] a finite-length window sequence of length L, and U is a normalizing 
constant. 

Show that the periodogram is also equal to l/LU times the Fourier transform of 
the aperiodic autocorrelation sequence of v[n]; i.e., 

1 L ' X 

m=-(L-\) 

where 

L-\ 

c vv [m] = 2^ v[n]v[n + m\. 

n=0 

10.27. Consider a finite-length sequence x[n] such that x[n] = for n < and n > L. Let A^[A:] 
be the jV-point DFT of the sequence x[ri\, where N > L. Define c^lm] to be the aperiodic 
autocorrelation function of x[/i]; i.e., 

c X x[m]= ^^ x[n]x[n-hm]. 

n=—oo 

Define 

1 * _1 
c„[m] = - Y^ \X[k\\ 2 e i{27T/N)km , m = 0, 1, . . . , N- 1. 

m=0 
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(a) Determine the minimum value of N that can be used for the DFT if we require that 

c X x[m] = c xx [m], < m < L - 1. 

(b) Determine the minimum value of N that can be used for the DFT if we require that 

c xx [m] = c xx [m], < m < M - 1 , 

where M < L. 

10.28. The symmetric Bartlett window, which arises in many aspects of power spectrum estima- 
tion, it is defined as 

» bW = (!- W « lm|<M-l, 

1 J 10, otherwise. v 

The Bartlett window is particularly attractive for obtaining estimates of the power spec- 
trum by windowing an estimated autocorrelation function, as discussed in Section 10.7. 
This is because its Fourier transform is nonnegative, which guarantees that the smoothed 
spectrum estimate will be nonnegative at all frequencies. 

(a) Show that the Bartlett window as defined in Eq. (P10.28-1) is (1/A/) times the aperiodic 
autocorrelation of the sequence (u[n\ — u[n — M\). 

(b) From the result of Part (a), show that the Fourier transform of the Bartlett window is 



W B (en = 1 



sin(a>M/2) 
sin(o)/2) 



(P10.28-2) 



which is clearly nonnegative. 
(c) Describe a procedure for generating other finite-length window sequences that have 
nonnegative Fourier transforms. 

10.29. In Section 10.7, we showed that a smoothed estimate of the power spectrum can be 
obtained by windowing an estimate of the autocorrelation sequence. It was stated (see 
Eq. (10.95)) that the variance of the smoothed spectrum estimate is 

var[S(a>)] ^ FP 2 xx (w), 
where F, the variance ratio or variance reduction factor, is 

i M ~ l i r 

F =Q Y, {Wc[m])2 = ^Qj I^Hfda,. 

m=—{M-\) ~ n 

As discussed in Section 10.7, <2is the length of the sequence x[n] and (2M— 1) is the length 
of the symmetric window w c [m] that is applied to the autocorrelation estimate. Thus, if Q 
is fixed, the variance of the smoothed spectrum estimate can be reduced by adjusting the 
shape and duration of the window applied to the correlation function. 

In this problem we will show that F decreases as the window length decreases, but 
we also know from the previous discussion of windows in Chapter 7 that the width of 
the main lobe of W c (e }co ) increases with decreasing window length, so that the ability to 
resolve two adjacent frequency components is reduced as the window width decreases. 
Thus, there is a trade-off between variance reduction and resolution. We will study this 
trade-off for the following commonly used windows: 

Rectangular 

' \, |m|<M-l, 



KV J 1 0, otherwise. 
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Bartlett (triangular) 



W »M = I Q 



1 - \m\/M, \m\ < M - 1, 
otherwise. 



Manning/ Hamming 



w h[™\ = I q 



a + /? cos[:rm/(A/ — 1)], |m| < M — 1, 

otherwise. 



(a = /* = 0.5 for the Harming window, and a = 0.54 and fi — 0.46 for the Hamming 
window.) 

(a) Find the Fourier transform of each of the foregoing windows; i.e., compute W^(e ;fU ), 
VVs(e ;w ), and Wji(e jco ). Sketch each of these Fourier transforms as functions of o). 

(b) For each of the windows, show that the entries in the following table are approximately 
true when M » 1: 



Window Name 



Approximate Approximate 

Main-lobe Width Variance Ratio (F) 



Rectangular InjM 

Bartlett An/M 

Hanning/Hamming 3n/M 



2M/Q 

2M/(3Q) 
2M(a 2 +^/2)/Q 



10.30. Consider a signal 



x[n] = 



sin 



7zn\ 
~2~) 



u[n] 



whose time-dependent discrete Fourier transform is computed using the analysis window 



w[n] = 



1, 0<rc<13. 
0, otherwise. 



Let X[n, k] = X[n, Ink/l) for < k < 6, where X[n, A) is defined as in Section 10.3. 

(a) Determine ^[0, k] for < k < 6. 

(b) Evaluate J2 k=0 X[n, k] for < n < oo. 



10.31. (a) Consider the system of Figure P10.31-1 with input x(t) = e 



_ „j(3jr/8)10 4 t 



, sampling period 



T= 10" 4 . and 



w[n] — 



1, <n < N-l, 
0, otherwise. 



What is the smallest nonzero value of N such that AV[&] is nonzero at exactly one 
value of kl 
(b) Suppose now that N = 32, the input signal is x{t ) = e jQo ' , and the sampling period T 
is chosen such that no aliasing occurs during the sampling process. Figures P10.31-2 
and P10.31-3 show the magnitude of the sequence X w [k] for k = 0, . . . , 31 for the 




x w [k] 



Figure P10.31-1 
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(d) 



following two different choices of w[n]: 



r , _ f 1, 0<n <31, 
1 ^ J — |0, otherwise, 



w 2 [n] = 



1, 0<«<7 f 
0, otherwise. 



Indicate which figure corresponds to which choice of w [ri\. State your reasoning clearly. 
(c) For the input signal and system parameters of Part (b), we would like to estimate the 
value of ^o from Figure P10.31-2 when the sampling period is T = 10 4 . Assuming 
that the sequence 



w[n] = 



1, 0<n<31, 
0, otherwise, 



and that the sampling period is sufficient to ensure that no aliasing occurs during 
sampling, estimate the value of £2o- Is your estimate exact? If it is not, what is the 
maximum possible error of your frequency estimate? 

Suppose you were provided with the exact values of the 32-point DFT ^[A;] for 
the window choices w\[n] and W2[«]. Briefly describe a procedure to obtain a precise 
estimate of ^o- 
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Extension Problems 

10.32. Show that the time-dependent Fourier transform, as defined by Eq. (10.18), has the fol- 
lowing properties: 

(a) Linearity: 

If x[n] = ax][n] + bx 2 [n], then X[n< A) = aX\[n, A) + bX 2 [n, A). 

(b) Shifting: If y[n] — x[n - «o], then Y[n, A) = X[n - n$. A). 

(c) Modulation: If y[n] = e^ on x[n], then Y[n, A) = e^° n X[n, A - (d {) )- 

(d) Conjugate Symmetry: If x[n] is real, then X[n,k) = X*[n, —A). 

10.33. Suppose that x c (t) is a continuous-time stationary random signal with autocorrelation 
function 

4>c(T)=£Mt)x c (t + T)} 

and power density spectrum 



■oc- 



Consider a discrete-time stationary random signal x[n] that is obtained by sampling x i: (t) 
with sampling period T\ i.e., jc[/i] = x c (nT). 

(a) Show that 0[m], the autocorrelation sequence for x[n], is 

0[m] = 4> c {mT). 

(b) What is the relationship between the power density spectrum P i: (Q) for the continuous- 
time random signal and the power density spectrum P(a>) for the discrete-time random 
signal? 

(c) What condition is necessary such that 

1 /(0\ 

P{^)=j p c\j)* M <7r? 

10.34. In Section 10.6.5, we considered the estimation of the power spectrum of a sinusoid plus 
white noise. In this problem, we will determine the true power spectrum of such a signal. 
Suppose that 

x[n] — Acos(cu {) n + 9) + e[n], 

where 6 is a random variable that is uniformly distributed on the interval from to 2n 
and e[n] is a sequence of zero-mean random variables that are uncorrelated with each 
other and also uncorrelated with 9. In other words, the cosine component has a randomly 
selected phase, and e[n] represents white noise. 

(a) Show that for the preceding assumptions, the autocorrelation function for x[n] is 

A 2 , 

<p xx [m] = £{jc[«]jc[m + n]} = — cos((uom) + o^8[m], 

where o] — £[(e[n]) 2 }. 

(b) From the result of Part (a), show that over one period in frequency, the power spectrum 
of x[n] is 

A 2 7T 
Pxx(0i) = — r— [8(co — (Dq) + 8(co + (Do)] + O 2 , \(D\ < 71. 
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10.35. Consider a discrete-time signal x[n] of length N samples that was obtained by sampling a 
stationary, white, zero-mean continuous-time signal. It follows that 

£(jc[rt]j:[m]} = <x v 2 £[« — ra], 
£{x[n]} = 0. 

Suppose that we compute the DFT of the finite-length sequence x[n], thereby obtaining 
X[k]fork = (), 1,...,N-1. 

(a) Determine the approximate variance of | A^A:]! 2 using Eqs. (10.65) and (10.66). 

(b) Determine the cross-correlation between values of the DFT; i.e., determine 
£{A'[/c]A r *|>-]} as a function of A: and r. 

10.36. A bandlimited continuous-time signal has a bandlimited power spectrum that is zero for 
1^1 > 27r(10 4 ) rad/s. The signal is sampled at a rate of 20,000 samples/s over a time 
interval of 10 s. The power spectrum of the signal is estimated by the method of averaging 
periodograms as described in Section 10.6.3. 

(a) What is the length Q (number of samples) of the data record? 

(b) If a radix-2 FFT program is used to compute the periodograms, what is the minimum 
length N if we wish to obtain estimates of the power spectrum at equally spaced 
frequencies no more than 10 Hz apart? 

(c) If the segment length L is equal to the FFT length N in Part (b), how many segments 
K are available if the segments do not overlap? 

(d) Suppose that we wish to reduce the variance of the spectrum estimates by a factor of 
10 while maintaining the frequency spacing of Part (b). Give two methods of doing 
this. Do these two methods give the same results? If not, explain how they differ. 

10.37. Suppose that an estimate of the power spectrum of a signal is obtained by the method of 
averaging periodograms, as discussed in Section 10.6.3. That is, the spectrum estimate is 

1 *-' 



/H = -^/ r H 



r=0 

where the K periodograms / r (<w) are computed from L-point segments of the signal using 
Eqs. (10.67) and (10.68). We define an estimate of the autocorrelation function as the 
inverse Fourier transform of I(co)\ i.e., 

4>[m] = -!- / I(w)e Ja,m dco, 

2 * J-n 

(a) Show that 

£{<j>[m\} = ——c ww [m](f> xx [m\, 

where L is the length of the segments, U is a normalizing factor given by Eq. (10.64), 
and Cn,w[w], given by Eq. (10.60), is the aperiodic autocorrelation function of the 
window that is applied to the signal segments. 

(b) In the application of periodogram averaging, we normally use an FFT algorithm to 
compute I(a>) at N equally spaced frequencies; i.e., 

I[k] = I(2jtk/N), k = Q,l,...,N-l, 

where N > L. Suppose that we compute an estimate of the autocorrelation function 
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by computing the inverse DFT of I[k], as in 

1 N ~ l 
$ p [ m ] = — ^2 I[k]e j{27T/N)km , m = 0,1 N - 1. 

Obtain an expression for S{4> p [m]). 
(c) How should N be chosen so that 

£{4> p [m]} =£"{<? [m]}, m = 0, 1 L- 1? 

10.38. Consider the computation of the autocorrelation estimate 

<?-|m|-l 

0.„M = - 5Z ^M^ + Nl- (Pio.38-1) 

where jc[/7] is a real sequence. Since A -. r [— m] = rx [w], it is necessary only to evaluate 
Eq. (P10.38-1) for < m < M - 1 to obtain $ xx [m] for -(A/ - 1) < m < M - 1, as is 
required to estimate the power density spectrum using Eq. (10.88). 
(a) When Q > A/, it may not be feasible to compute $ xx [tn] using a single FFT computa- 
tion. In such cases, it is convenient to express <p xx \m\ as a sum of correlation estimates 
based on shorter sequences. Show that if Q = KM, 

1 K ~ ] 

^ 1=0 

where 



d [m] = 2_, x[n + i M]x[n + i M + m]. 



n=0 

forO < m < M - 1. 
(b) Show that the correlations tj[m] can be obtained by computing the Appoint circular 
correlations 

N-\ 

cA m \ = ^ Xi [n]yi[{{n 4- m)) N ], 

n=0 

where the sequences 

x[n + iM), 0<«<Af-l, 



X, "W- |0, M<n<N-l, 

and 

y t [n] =jc[« + /Af]. 0<« < A/-1. (P10.38-2) 

What is the minimum value of Af (in terms of M) such that c,[w] = c, [m\ for < m < 
A/-1? 

(c) State a procedure for computing 4> xx [m] for < m < M — 1 that involves the com- 
putation of 2# Appoint DFTs of real sequences and one Appoint inverse DFT. How 
many complex multiplications are required to compute $ xx [m] for < m < M — 1 if 
a radix-2 FFT is used? 

(d) What modifications to the procedure developed in Part (c) would be necessary to 
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compute the cross-correlation estimate 

Q-\m\-\ 

4>xv[ m ] — 7; 5Z ^Myt" + m ]' —(M- 1) < m < M— 1, 

n=0 

where jc[m] and y[n] are real sequences known for < n < <2 — 1? 
(e) Rader (1970) showed that, for computing the autocorrelation estimate </> vjr [m] for 
< m < M — 1, significant savings of computation can be achieved if N = 2M. Show 
that the iY-point DFT of a segment y, [n] as defined in Eq. (P10.38-2) can be expressed 
as 

Yj[k] = Xi[k] + {-\) k X i+l [k], k = 0A,...,N~\. 

State a procedure for computing vv [m] for < m < A/— 1 that involves the computa- 
tion of K TV-point DFTs and one AZ-point inverse DFT. Determine the total number 
of complex multiplications in this case if a radix-2 FFT is used. 

10.39. In Section 10.3 we defined the time-dependent Fourier transform of the signal x[m] so that, 
for fixed n, it is equivalent to the regular discrete-time Fourier transform of the sequence 
jc[n+w]w[m], where w[m] is a window sequence. It is also useful to define a time-dependent 
autocorrelation function for the sequence x[n] such that, for fixed n, its regular Fourier 
transform is the magnitude squared of the time-dependent Fourier transform. Specifically, 
the time-dependent autocorrelation function is defined as 

c[«,m] = —/ \X[n,k)\ 2 e' km dK 

l7t J-TZ 

where X[n, A) is defined by Eq. (10.18). 

(a) Show that if x[n] is real 

c[n,m\— y x[n + r]w[r]x[m + n + r]w[m + r]; 

r——oc 

i.e., for fixed n, c[n, m] is the aperiodic autocorrelation of the sequence x[n + r]w[r], 
— 00 < r < 00. 

(b) Show that the time-dependent autocorrelation function is an even function of m for 
n fixed, and use this fact to obtain the equivalent expression 

c[n, m] = 2, x[r]x[r — m]h m [n — r], 

r—— oc 

where 

h m [r] = w[-r]w[-(m + r)]. (P10.39-1) 

(c) What condition must the window w[r] satisfy so that Eq. (P10.39-1) can be used to 
compute c[n, m] for fixed m and —00 < n < 00 by causal operations? 

(d) Suppose that 

(V. r>0, 
w[-r] = { (P10.39-2) 

[0, r < 0. 

Find the impulse response h m [r] for computing the mth autocorrelation lag value, and 
find the corresponding system function H m (z). From the system function, draw the 
block diagram of a causal system for computing the mth autocorrelation lag value 
c[n, m] for — 00 < n < cc for the window of Eq. (P10.39-2). 



Chap. 10 Problems 



769 



(e) Repeat Part (d) for 



w[-r] = 



ra r '. r > 0, 



0, 



r <0. 



10.40. Time-dependent Fourier analysis is sometimes implemented as a bank of filters, and even 
when FFT methods are used, the filter bank interpretation may provide useful insight. 
This problem examines that interpretation, the basis of which is the fact that when A is 
fixed, the time-dependent Fourier transform X[n, A), defined by Eq. (10.18), is simply a 
sequence that can be viewed as the result of a combination of filtering and modulation 
operations. 

(a) Show that X[n, A) is the output of the system of Figure P10.40-1 if the impulse re- 
sponse of the linear time-invariant system is ho[n] — w[ — n]. Show also that if A is 
fixed, the overall system in Figure P10.40-1 behaves as a linear time-invariant system, 
and determine the impulse response and frequency response of the equivalent LTI 
system. 




X(n,\) 



Figure P10.40-1 

(b) Assuming A fixed in Figure P10.40-1, show that, for typical window sequences and for 
fixed A, the sequence s[n] = X[n, A) has a lowpass discrete-time Fourier transform. 
Show also that, for typical window sequences, the frequency response of the overall 
system in Figure P10.40-1 is a bandpass filter centered at co — A. 

(c) Figure P10.40-2 shows a bank of N bandpass filter channels, where each channel 
is implemented as in Figure PI 0.40-1. The center frequencies of the channels are 
A/t = 2nk/N, and ho[n] — w[—n] is the impulse response of a lowpass filter. Show that 
the individual outputs yk[n] are samples (in the A-dimension) of the time-dependent 
Fourier transform. Show also that the overall output is y[n] = w[0]x[n]\ i.e., show that 
the system of Figure P10.40-2 reconstructs the input exactly (within a scale factor) 
from the sampled time-dependent Fourier transform. 




e-i k N-i* eAvi" Figure P1 0.40-2 

The system of Figure P10.40-2 converts the single input sequence x[n] into N sequences, 
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thereby increasing the total number of samples per second by the factor N. As shown in 
Part (b), for typical window sequences, the channel signals y^n] have lowpass Fourier 
transforms. Thus, it should be possible to reduce the sampling rate of these signals, as 
shown in Figure P10.40-3. In particular, if the sampling rate is reduced by a factor R= N, 
the total number of samples per second is the same as for x[n]. In this case, the filter 
bank is said to be critically sampled. (See Crochiere and Rabiner, 1983.) Reconstruction 
of the original signal from the decimated channel signals requires interpolation as shown. 
Clearly, it is of interest to determine how well the original input x[n] can be reconstructed 
by the system. 



x[n] 
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Figure P1 0.40-3 



(d) For the system of Figure P10.40-3, show that the regular discrete-time Fourier trans- 
form of the output is given by the relation 



R { N-l 



where X^ = 2nkjN. This expression clearly shows the aliasing resulting from the 
decimation of the channel signals y [n]. From the expression for Y(e^), determine a 
relation or set of relations that must be satisfied jointly by Ho(e^ <0 ) and Go(e ;w ) such 
that the aliasing cancels and y[n] — x[n]. 
(e) Assume that R= N and the frequency response of the lowpass filter is an ideal lowpass 
filter with frequency response 



H Q (e'n = 



1, \co\ < it /N, 

0, ix IN < M < 7i. 



For this frequency response Ho(e^ (l) ), determine whether it is possible to find a fre- 
quency response of the interpolation filter Go(e ;&J ) such that the condition derived in 
Part (d) is satisfied. If so, determine Go(e yViJ ). 
(f) Optional; Explore the possibility of exact reconstruction when the frequency response 
of the lowpass filter Ho(e^°) (the Fourier transform of w[— n]) is nonideal and nonzero 
in the interval \co\ < In IN. 
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(g) Show that the output of the system of Figure P10.40-3 is 

OQ OO 

y [n] = N Y^ x[n-rN] ^ g Q [n - t R]k Q [l R + r N - n]. 

From this expression, determine a relation or set of relations that must be satisfied 
jointly by ho[n] and go[n] such that y[n] — x[n]. 
(h) Assume that R = N and the impulse response of the lowpass filter is 

1, -(iV-l)<n<0, 



J ^ 0, otherwise. 

For this impulse response ho[n], determine whether it is possible to find an impulse 
response of the interpolation filter go[n] such that the condition derived in Part (g) is 
satisfied. If so, determine go[n]. 
(i) Optional: Explore the possibility of exact reconstruction when the impulse response 
of the lowpass filter ho[n\ — w[~ri\ is a tapered window with length greater than 
N. 

10.41. Consider a stable linear time-invariant system with a real input x[n], a real impulse re- 
sponse h[n], and output y[n]. Assume that the input x[n] is white noise with zero mean 
and variance a]. The system function is 

M 

H(z) = -*=!L , 

where we assume the a^s and £;t's are real for this problem. The input and output satisfy 
the following difference equation with constant coefficients: 

N M 

y[n] = ^ aky [ n ~ k 1 + 5Z bkX ^ n ~ k ^' 

k=l k=0 

If all the ajt's are zero, y[n] is called a moving-average (MA) linear random process. If 
all the bjt's are zero, except for b$, then y[n] is called an autoregressive (AR) linear ran- 
dom process. If both N and M are nonzero, then y[n] is an autoregressive moving-average 
(ARMA) linear random process. 

(a) Express the autocorrelation of y[n] in terms of the impulse response h[n] of the linear 
system. 

(b) Use the result of Part (a) to express the power density spectrum of y[n] in terms of 
the frequency response of the system. 

(c) Show that the autocorrelation sequence <f> yy [m] of an MA process is nonzero only in 
the interval \m\ < M. 

(d) Find a general expression for the autocorrelation sequence for an AR process. 

(e) Show that if bo = 1, the autocorrelation function of an AR process satisfies the dif- 
ference equation 

N 

k=\ 

N 



4>yy[m] = 2_\, ak( ^yy^ m ~ k], m> 1. 



k=\ 
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(f) Use the result of Part (e) and the symmetry of <£ yy [m] to show that 



N 



^ ak4> yy [\m - k\] = 4> yy [m], m = l,2,...,N, 



k=l 

It can be shown that, given ^> yy [w] for m = 0,1 N, we can always solve uniquely 

for the values of the a^s and a^ for the random-process model. These values may be 
used in the result in Part (b) to obtain an expression for the power density spectrum 
of y[n]. This approach is the basis for a number of parametric spectrum estimation tech- 
niques. (For further discussion of these methods, see Gardner, 1988; Kay, 1988; and Marple, 
1987.) 

10.42. This problem illustrates the basis for an FFT-based procedure for interpolating the sam- 
ples (obtained at a rate satisfying the Nyquist theorem) of a periodic continuous-time 
signal. Let 

4 /. x |*| 



«>-*x:(i) 

k=-4 x 7 



Jkt 



be a periodic signal that is processed by the system in Figure P10.42-1. 

(a) Sketch the 16-point sequence G[k]. 

(b) Specify how you would change G [k] into a 32-point sequence Q [k] so that the 32-point 
inverse DFT of Q[k] is a sequence 

r , f til 7i \ 

q[n]=ax c I — 1, < n < 31, 

for some nonzero constant a. You need not specify the value of a. 



C/D 

T 



x[n) 



■0 



g[«] 



16-point 
DFT 



G[k] 



T = 



16 



u[n] - u[n - 16] 



Figure P10.42-1 



10.43. In many real applications, practical constraints do not allow long time sequences to 
be processed. However, significant information can be gained from a windowed sec- 
tion of the sequence. In this problem, you will look at computing the Fourier trans- 
form of an infinite-duration signal x[n], given only a block of 256 samples in the range 
< n < 255. You decide to use a 256-point DFT to estimate the transform by denning 
the signal 



-r i _ /*["]> 0<n< 255, 
L \ 0, otherwise, 



and computing the 256-point DFT of x[n]. 

(a) Suppose the signal x[n] came from sampling a continuous-time signal x c (t) with sam- 
pling frequency f s = 20 kHz; i.e., 

x[n] = x c (nT s ), 

1/7; =20 kHz. 

Assume that x c (t) is bandlimited to 10 kHz. If the DFT of x[n] is written X[k], k — 
0, 1, ... , 255, what are the continuous-time frequencies corresponding to the DFT 
indices k = 32 and k = 231? Be sure to express your answers in Hertz. 
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(b) Express the DTFT of x[n] in terms of the DTFT of x[n] and the DTFT of a 256-point 
rectangular window w g[n]. Use the notation X(e^) and W/?(e JW ) to represent the 
DTFTs of x[n] and vv^[«], respectively. 

(c) Suppose you try an averaging technique to estimate the transform for k — 32: 

* a »g[32] = a JT[31] + X [32] + aX[33]. 

Averaging in this manner is equivalent to multiplying the signal x[n] by a new window 
WaugM before computing the DFT. Show that W avg (e }a) ) must satisfy 



Wa„g(0 = 



(O = 0, 

co = 27ik/L, 



for k = 2, 3 L - 2, 



where £ = 256. 

(d) Show that the DTFT of this new window can be written in terms of Wji(e Jeu ) and two 
shifted versions of Wn(e Ja >). 

(e) Derive a simple formula for w a i; g [rt], and sketch the window for a. = —0.5 and 
< n < 255. 

10.44- It is often of interest to zoom in on a region of a DFT of a signal to examine it in more 
detail. In this problem, you will explore two algorithms for implementing this process of 
obtaining additional samples of X(e^ M ) in a frequency region of interest. 

Suppose At^/:] is the TV-point DFT of a finite-length signal x[n]. Recall that X^[k] 
consists of samples of X{e^) every 2tt/N in co. Given Xs[k\ we would like to compute 
N samples of X(ei'°) between co = co c — Aco and co = co c + Aco with spacing 2Aw/N, 
where 

2 Tike 

co c = -— 

N 

and 

27t/Ca 

This is equivalent to zooming in on X{e' }<3> ') in the region co c — Aco < co < co c + Aw. One 
system used to implement the zoom is shown in Figure P10.44-1. Assume that x z [n] is 
zero-padded as necessary before the iV-point DFT and h[n] is an ideal lowpass filter with 
a cutoff frequency Aco. 



Aco = 



X N [k] 



N-point 
IDFT 


>C 




h[n] 




\m 




N-point 
DFT 


V J 

x[n] Y 
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,}<o c n 



Figure P10.44-1 



a X(ei») 




c - Ao> o) c oj c + Aw 



Figure P10.44-2 
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(a) In terms of & A and the transform length N, what is the largest (possibly noninteger) 
value of M that can be used if aliasing is to be avoided in the downsampler. 

(b) Consider x[n] with the Fourier transform shown in Figure P10.44-2. Using the max- 
imum value of M from Part fa), sketch the Fourier transforms of the intermediate 
signals x e [n] and x z [n] when io c — n/2 and Aco = tt/6. Demonstrate that the system 
provides the desired frequency samples. 

Another procedure for obtaining the desired samples can be developed by viewing the 
finite-length sequence A^[A:] indexed on A: as a discrete-time data sequence to be processed 
as shown in Figure P10.44-3. The impulse response of the first system is 



p[n]= ^ &[n+rN], 



and the filter h[n] has the frequency response 



H(e jl °) = 



1, M < n/M, 
0, otherwise. 



The zoomed output signal is defined as 

X z [n] = X NM [k c - k A + n], S n < N - 1, 
for appropriate values of k c and k A . 




\M 



h\n] 



^NM\ 



Extract correct 
portion of 
sequence 



x z [n] 



Figure P1 0.44-3 



Assume that k A is chosen so that M is an integer in the following parts. 

(c) Suppose that the ideal lowpass filter h[n] is approximated by a causal Type I linear- 
phase filter of length 513 (nonzero for < n < 512). Indicate which samples of 
X nm[h] provide the desired frequency samples. 

(d) Using sketches of a typical spectrum for AV[A:] and X(e Ja> ), demonstrate that the 
system in Figure P10.44-3 produces the desired samples. 
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11.0 INTRODUCTION 

In general, the specification of the Fourier transform of a sequence requires complete 
knowledge of both the real and imaginary parts of the magnitude and phase for all 
frequencies in the range — n < u> < n. However, we have seen that under certain con- 
ditions there are constraints on the Fourier transform. For example, in Section 2.8 we 
saw that if x[n] is real, then its Fourier transform is conjugate symmetric, i.e., X{e^) = 
X*(e~i w ). From this, it follows that for real sequences, specification of X(e^ w ) for 
< co < n also specifies it for — n < to < 0. Similarly, we saw in Section 5.4 that 
under the constraint of minimum phase, the Fourier transform magnitude and phase 
are not independent; i.e., specification of magnitude determines the phase and speci- 
fication of phase determines the magnitude to within a scale factor. In Section 8.5 we 
saw that for sequences of finite length N, specification of X(e^) at N equally spaced 
frequencies determines X(e ja) ) at all frequencies. 

In this chapter, we will see that the constraint of causality of a sequence implies 
unique relationships between the real and imaginary parts of the Fourier transform. 
Relationships of this type between the real and imaginary parts of complex functions 
arise in many fields besides signal processing, and they are commonly known as Hilbert 
transform relationships. In addition to developing these relationships for the Fourier 
transform of causal sequences, we will develop related results for the DFT and for 
sequences with one-sided Fourier transforms. Also, in Section 11.3 we will indicate how 
the relationship between magnitude and phase for minimum-phase sequences can be 
interpreted in terms of the Hilbert transform. 

Although we will take an intuitive approach in this chapter, it is important to be 
aware that the Hilbert transform relationships follow formally from the properties of 
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analytic functions. (See Problem 11.21.) Specifically, the complex functions that arise 
in the mathematical representation of discrete-time signals and systems are generally 
very well behaved functions. With few exceptions, the z-transforms that have concerned 
us have had well-defined regions in which the power series is absolutely convergent. 
Since a power series represents an analytic function within its region of convergence, it 
follows that z-transforms are analytic functions inside their regions of convergence. By 
the definition of an analytic function, this means that the z-transform has a well-defined 
derivative at every point inside the region of convergence. Furthermore, analyticity 
implies that the z-transform and all its derivatives are continuous functions within the 
region of convergence. 

The properties of analytic functions imply some rather powerful constraints on 
the behavior of the z-transform within its region of convergence. Since the Fourier 
transform is the z-transform evaluated on the unit circle, these constraints also restrict 
the behavior of the Fourier transform. One such constraint is that the real and imaginary 
parts satisfy the Cauchy-Riemann conditions, which relate the partial derivatives of the 
real and imaginary parts of an analytic function. (See, for example, Churchill and Brown, 
1990.) Another constraint is the Cauchy integral theorem, through which the value of 
a complex function is specified everywhere inside a region of analyticity in terms of the 
values of the function on the boundary of the region. On the basis of these relations 
for analytic functions, it is possible, under certain conditions, to derive explicit integral 
relationships between the real and imaginary parts of a z-transform on a closed contour 
within the region of convergence. In the mathematics literature, these relations are 
often referred to as Poisson's formulas. In the context of system theory, they are known 
as the Hilbert transform relations. 

Rather than following the mathematical approach just discussed, we will develop 
the Hilbert transform relations by exploiting the fact that, on the unit circle, the real 
and imaginary parts of the z-transform of a causal sequence are the transforms of the 
even and odd components, respectively, of the sequence (properties 5 and 6, Table 2.1). 
As we will show, a causal sequence is completely specified by its even part, implying 
that the z-transform of the original sequence is completely specified by its real part 
on the unit circle. In addition to applying this argument to specifying the z-transform 
of a particular causal sequence in terms of its real part on the unit circle, we can also 
apply it, under certain conditions, to specify the z-transform of a sequence in terms of 
its magnitude on the unit circle. 

The notion of an analytic signal is an important concept in continuous-time signal 
processing. An analytic signal is a complex time function (which is analytic) having a 
Fourier transform that vanishes for negative frequencies. A complex sequence cannot 
be considered in any formal sense to be analytic, since it is a function of an integer 
variable. However, in a style similar to that described in the previous paragraph, it is 
possible to relate the real and imaginary parts of a complex sequence whose spectrum 
is zero on the unit circle for — it < a) < 0. A similar approach can also be taken in 
relating the real and imaginary parts of the discrete Fourier transform for a periodic or, 
equivalently, a finite-length sequence. In this case, the "causality" condition is that the 
periodic sequence be zero in the second half of each period. 

Thus, in this chapter, a notion of causality will be applied to relate the even and odd 
components of a function or, equivalently, the real and imaginary parts of its transform. 
We will apply this approach in four situations. First, we relate the real and imaginary 
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parts of the Fourier transform X(e^) of a sequence x[n] that is zero for n < 0. In the 
second situation, we obtain a relationship between the real and imaginary parts of the 
DFT for periodic sequences or, equivalently, for a finite-length sequence considered to 
be of length N, but with the last (N/2) — 1 points restricted to zero. In the third case, 
we relate the real and imaginary parts of the logarithm of the Fourier transform under 
the condition that the inverse transform of the logarithm of the transform is zero for 
n < 0. Relating the real and imaginary parts of the logarithm of the Fourier transform 
corresponds to relating the log magnitude and phase of X(e^). Finally, we relate the 
real and imaginary parts of a complex sequence whose Fourier transform, considered 
as a periodic function of a), is zero in the second half of each period. 



11.1 REAL- AND IMAGINARY-PART SUFFICIENCY OF THE 
FOURIER TRANSFORM FOR CAUSAL SEQUENCES 

Any sequence can be expressed as the sum of an even sequence and an odd sequence. 
Specifically, with x e [n] and x [n] denoting the even and odd parts, respectively, of x[n], 1 
we have 

x[n] — x e [n] + x Q [n], (11-1) 

where 

xM = *[»]+*[-] (1L2) 



and 



x[n]-x[-n] 
x o[n] = • (11.3) 



Equations (11.1)— (11.3) apply to an arbitrary sequence, whether or not it is causal and 
whether or not it is real. However, if x[n] is causal, i.e., if x[n] = 0, n < 0, then it is 
possible to recover x[n] from x e [n] or to recover x[n] for n ^ from x [n]. Consider, 
for example, the causal sequence x[n] and its even and odd components, as shown in 
Figure 11.1. Because x[n] is causal, x[n] = for n < and x[— n] = for n > 0. 
Therefore, the nonzero portions of x[n] and x[— n] do not overlap except at n = 0. For 
this reason, it follows from Eqs. (11.2) and (11.3) that 

x[n] = 2x e [n]u[n] ~ x e [0]S[n] (11.4) 

and 

x[n] = 2x [n]u[n] + Jt[0]<5[n]. (11.5) 

The validity of these relationships is easily seen in Figure 11.1. Note that x[n] is com- 
pletely determined by x e [n]. On the other hand, x o [0] = 0, so we can recover x[n] from 
x [n] only for n ^ 0. 

^f x[n] is real, then x e [n] and x [n] in Eqs. (11.2) and (11.3) are the even and odd parts, respectively, 
of x[n] as considered in Chapter 2. If x[n] is complex, for the purposes of this discussion we still define x e [n] 
and x [n] as in Eqs. (11.2) and (11.3), which do not correspond to the conjugate-symmetric and conjugate- 
antisymmetric parts of a complex sequence as considered in Chapter 2. 
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Figure 11.1 Even and odd parts of a 
real causal sequence. 



Now, if x[n] is also stable, i.e., absolutely summable, then its Fourier transform 
exists. We denote the Fourier transform of x[n] as 



X(en = XR(en + JXi(e ia> l 



(11.6) 



where Xr^^) is the real part and Xi{e jco ) is the imaginary part of X(e^ w ). Recall that 
if x[n] is a real sequence, then Xr{c iw ) is the Fourier transform of x e [n\ and jXi{e^ w ) 
is the Fourier transform of x [ri\. Therefore, for a causal, stable, real sequence, X R (e^) 
completely determines X(e )0J ), since, if we are given XR(e }a) ), we can find X(e^) by 
the following process: 

1. Find x e [n] as the inverse Fourier transform of XR(e^ w ). 

2. Find x[n] using Eq. (11.4). 

3. Find X(e^ w ) as the Fourier transform of x[n]. 

This also implies, of course, that Xi(e ico ) can be determined from Xr^^). In 
Example 11.1, we illustrate how this procedure can be applied to obtain X(e^) and 
Xfie^) from X R (e> a ). 
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Example 11.1 Finite-Length Sequence 

Consider a real, causal sequence x[n] for which Aj?(e ;ft> ), the real part of the DTFT, is 

X R (ei° , ) = l+ca&2co. (11.7) 

We would like to determine the original sequence x[n], its Fourier transform X{e^), 
and the imaginary part of the Fourier transform, Xj(e^). As a first step, we rewrite 
Eq. (11.7) expressing the cosine as a sum of complex exponentials: 

X R {e Ja) ) = 1 + ~e~ i2a + \e j2< °. (11.8) 

We know that Xr^^) is the Fourier transform of x e [n], the even part of x[n] as 
defined in Eq. (11.2). Comparing Eq. (11.8) with the definition of the Fourier trans- 
form, Eq. (2.134), we can match terms to obtain 

x e [n] = 8[n] + -8[n - 2] + ~8[n + 2]. 

Now that we have obtained the even part, we can use the relation in Eq. (11.4) to 
obtain 

x[n] = 8[n] + 8[n-2]. (11.9) 

From jc[n], we get 

X(0 = 1 + e' jlo} 

- 1 + cos2ft>- ;'sin2ft>. (11.10) 

From Eq. (11.10), we can both confirm that Aj?(e yaJ ) is as specified in Eq. (11.7) and 
also obtain 

A>(e^) = -sin2«y. (11.11) 

As an alternative path to obtaining X/(e }( °), we can first use Eq. (11.3) to get x [n] 
from x[n]. Substituting Eq. (11.9) into Eq. (11.3) then yields 

x a [n] = -8[n-2]~ -8[n + 2]. 
The Fourier transform of x [n] is jXi(e^), so we find 

jXi(e } ") = \e~ !2w - \e j2( * = ~j sin2w, 
so that 

A>(0 = -sin2o>, 

which is consistent with Eq. (11.11). 



Example 1 1.2 Exponential Sequence 

Let 

X R (en= , ';° C0S : 2 . |a|<l. (11.12) 

1 — La, cos co + or 
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or equivalently, 

XR(en i-(a/2)(«>- + «-*■) |a|<1 (1U3) 

v ' 1 - a(e^ + e-i°>) + a 2 ' 

with a real. We first determine x e [n] and then *[n] using Eq. (11.4). 

To obtain x e [ri\, the inverse Fourier transform of XR(e^ M ), it is convenient to first 
obtain Xr(z), the z-transform of x e [ri\. This follows directly from Eq. (11.13), given 
that 

X R (en = X R (z)\ z=e ; w . 

Consequently, by replacing e iia by z in Eq. (11.13), we obtain 

X R( z)= l- (a 'f%\\ (11.14) 

1 -a{z + z l ) + a l 



1- fCz + z- 1 ) 
(I - azr l ){l - az)' 



(11.15) 



Since we began with the Fourier transform Xr{c^) and obtained Xr{z) by 
extending XR{e i<0 ) into the z-plane, the ROC of Xr(z) must, of course, include the 
unit circle and is then bounded on the inside by the pole at z = a and on the outside 
by the pole at z = l/ot. 

From Eq. (1 1.15), we now want to obtain x e [ri\, the inverse ^-transform of Xr{z). 
We do this by expanding Eq. (11.15) in partial fractions, yielding 



Xr(z) = \ 



1 1 

+ 



1 — az~ l 1 — az 



(11.16) 



with the ROC specified to include the unit circle. The inverse z-transform of Eq. (1 1.16) 
can then be applied separately to each term to obtain 

x e [n] = l -a n u[n] + ^a~ n u[-n]. (11.17) 

Consequently, from Eq. (11.4), 

x[n] = a n u[n] + a~ n u[— n]u[n] — 8[n] 
= a n u[n], 
X{e }0) ) is then given by 

1 — ote 1*° 
and X(z) is given by 

X{z) = 1 1 _, \z\>\a\. (11.19) 

1 — az l 

The constructive procedure illustrated in Example 11.1 can be interpreted analyti- 
cally to obtain a general relationship that expresses Xi(e^) directly in terms of Xn(e i<0 ). 
From Eq. (11.4), the complex convolution theorem, and the fact that x e [0] = x[0], it 
follows that 

X(e jco ) = - r X B (e je )U(e j ^-^)d9 - x[Q], (11.20) 
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where U(e^) is the Fourier transform of the unit step sequence. As stated in Section 2.7, 
although the unit step is neither absolutely summable nor square summable, it can be 
represented by the Fourier transform 

*/(*'"")= £ nS(a>-2nk) + (11.21) 

K=-oo e 

or, since the term 1/(1 - e _;w ) can be rewritten as 

1 * Zcot^V (11.22) 



1 - e-* ' 2 2 V 2 / 
Eq. (11.21) becomes 

U(en = J2 nS ^ - 2nk ) + 2 - 2 COt (l) ' (11 ' 23) 

k— — oo 

Using Eq. (11.23), we can express Eq. (11.20) as 

X{en = X R (en + jX { (en 

= X R (en + ^£ X R (e* )de (11.24) 

- ^ £ W') cot (~) ^ - *[0]. 
Equating real and imaginary parts in Eq. (11.24) and noting that 

x[0] = ^ J* X R (e> )d9, (11.25) 

we obtain the relationship 

Xiie '" ) = ~ii£ x XRie ' 9)cat {^r) M - (1U6) 

A similar procedure can be followed to obtain x[n] and X(e^ w ) from Xi(e^) and x[0] 
using Eq. (11.5). This process results in the following equation for X R (e^) in terms of 
Xj(en: 

X R (en = x[0] + ^f_ *,(^)cot (^) d0. (11.27) 

Equations (11.26) and (11.27), which are called discrete Hilbert transform rela- 
tionships, hold for the real and imaginary parts of the Fourier transform of a causal, 
stable, real sequence. They are improper integrals, since the integrand is singular at 
co — =0. Such integrals must be evaluated carefully to obtain a consistent finite result. 
This can be done formally by interpreting the integrals as Cauchy principal values. That 
is, Eq. (11.26) becomes 

Xi(e'n = ~V j* X R {e!°)col (~) d0, (11.28) 

and Eq. (11.27) becomes 

X R (en = x[0] + ±~vj* A/(e'*)cot fe^) d6, (11.29) 
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XrW*) 




Figure 11.2 Interpretation of the 
Hilbert transform as a periodic 
convolution. 



where V denotes the Cauchy principal value of the integral that follows. The meaning 
of the Cauchy principal value in Eq. (11.28), for example, is 



X { (e^) = --- lim 
7 lit e-+0 



f X R (e* 9 ) 

Ja>+£ 

+ r £ ^(^>cot 
j —it 



cot I ^— dO 



(11.30) 



co-e 



dO 



Equation (11.30) shows that Xj(e^) is obtained by the periodic convolution of 
— cot(co/2) with X^e^), with special care being taken in the vicinity of the singularity 
at = co. In a similar manner, Eq. (11.29) involves the periodic convolution of cot(co/2) 
with Xi (ei w ). 

The two functions involved in the convolution integral of Eq. (11.28) (or, equiva- 
lent^, Eq. (11.30) are illustrated in Figure 11.2. The limit in Eq. (11.30) exists because 
the function cot[(co — 0)/2] is antisymmetric at the singular point = co and the limit is 
taken symmetrically about the singularity. 



11.2 SUFFICIENCY THEOREMS FOR 
FINITE-LENGTH SEQUENCES 

In Section 11.1, we showed that causality or one-sidedness of a real sequence implies 
some strong constraints on the Fourier transform of the sequence. The results of the pre- 
vious section apply, of course, to finite-length causal sequences, but since the finite-length 
property is more restrictive, it is perhaps reasonable to expect the Fourier transform of 
a finite-length sequence to be more constrained. We will see that this is indeed the case. 
One way to take advantage of the finite-length property is to recall that finite- 
length sequences can be represented by the discrete Fourier transform. Since the DFT 
involves sums rather than integrals, the problems associated with improper integrals 
disappear. 
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Since the DFT is, in reality, a representation of a periodic sequence, any results 
we obtain must be based on corresponding results for periodic sequences. Indeed, it 
is important to keep the inherent periodicity of the DFT firmly in mind in deriving 
the desired Hilbert transform relation for finite-length sequences. Therefore, we will 
consider the periodic case first and then discuss the application to the finite-length case. 

Consider a periodic sequence x[n] with period N that is related to a finite-length 
sequence x[n] of length TV by 

x[n]=x[((n)) N ]. (11.31) 

As in Section 11.1, x[n] can be represented as the sum of an even and odd periodic 
sequence, 

x[n] = x e [n] + x [n] t n = 0, 1, . . . , (N - 1), (1 1.32) 



where 



and 



x e [n] = x[n] \ x[ n \ « = 0,1 (/^-l), (H.33a) 



Un] = X[n] 2 Xl H \ n = 0, 1, . . . , (N - 1). (11.33b) 

A periodic sequence cannot, of course, be causal in the sense used in Section 11.1. 
We can, however, define a "periodically causal" periodic sequence to be a periodic 
sequence for which x[n] = for N/2 < n < N. That is, x[n] is identically zero over 
the last half of the period. We assume henceforth that TV is even; the case of N odd is 
considered in Problem 11.23. Note that because of the periodicity of x[n], it is also true 
that x[n] = for —N/2 < n < 0. For finite-length sequences, this restriction means 
that although the sequence is considered to be of length N, the last (N/2) — 1 points 
are in fact zero. In Figure 11.3, we show an example of a periodically causal sequence 
and its even and odd parts with N = 8. Because x[n] is zero in the second half of each 
period, x[—n] is zero in the first half of each period, and, consequently, except for n = 
and n — N/2, there is no overlap between the nonzero portions of x[n] and x[~ n]. 
Therefore, for periodically causal periodic sequences, 

2x e [n], « = l,2,...,(N/2)-l, 
x[n] = { x e [nl n = 0, N/2, (11.34) 

0, » = (tf/2) + !,...,#-!, 



and 



*r„i _ J 2*o[n], n = 1, 2 (N/2) - 1, m ... 

* L " J ~^ 0, « = (iV/2) + l JV-1. K } 



If we define the periodic sequence 

ri, /i = o,;v/2, 

u N [n]={2, /i = l,2,...,W2)-l, (11.36) 

(0, « = (iV/2) + l JV-1, 

then it follows that, for Af even, we can express x[n] as 

x[n] — Jte[/i]w#M (11.37) 
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Figure 11 .3 Even and odd parts of a periodically causal, real, periodic sequence 
of period N = 8. 



and 



x[ n ] = x [n]u N [n] + x[0]8[n] + x[N/2]S[n - (N/2)], 



(11.38) 



where 8[n] is a periodic unit-impulse sequence with period N. Thus, the sequence x[n] 
can be completely recovered from x e [ri\. On the other hand, x [n] will always be zero at 
n = and /? = N/2, and consequently, x[/i] can be recovered from x [n] only for n ^ 
and /i ^ TV/2. 

If Jc[«] is a real periodic sequence of period N with discrete Fourier series X[k], 
then ^[A:], the real part of X[k], is the DFS of x e [n] and jX^k] is the DFS of x [n]. 
Hence, Eqs. (11.37) and (11.38) imply that, for a periodic sequence of period N, which is 
periodically causal in the sense defined earlier, X[k] can be recovered from its real part 
or (almost) from its imaginary part. Equivalently, Xj[k] can be obtained from X^[/c], 
and Xji[k\ can (almost) be obtained from X/[/c]. 

Specifically, suppose that we are given X/?[/c]. Then we can obtain X[k] and X[[k] 
by the following procedure: 



1. Compute x e [n] using the DFS synthesis equation 

JV-l 

N 



xe[n]= -J2XRlk]e ji2n/N)kn . 



(11.39) 



k=0 



2. Compute x[n] using Eq. (11.37). 
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3. Compute X[k] using the DFS analysis equation 

N-l 

X[k] = J2 x[n]e- i(2n/N)kn = X R [k] + jX,[k]. (11.40) 

Jt=0 

In contrast to the general causal case discussed in Section 11.1, the procedure just 
outlined can be implemented on a computer, since Eqs. (11.39) and (11.40) can be 
evaluated accurately and efficiently using an FFT algorithm. 

To obtain an explicit relation between X/?[/c], and A/[/c], we can carry out the 
procedure analytically. From Eq. (11.37) and Eq. (8.34), it follows that 

X[k] = X R [k] + jXj[k] 

1 N-i (11.41) 

m=0 

i.e., X[k] is the periodic convolution of X R [k], the DFS of x e [n\, with U ^[k\ the DFS of 
M/v[n]. The DFS of u^[n] can be shown to be (see Problem 11.22) 

N, k=0, 

U N [k] = { -j2cot(jrk/N), kodd, (11.42) 

0, A: even. 



Mk]={o J2C ° t(,Tk/N) ' t!l d ; (11-43) 



If we define 

A: even, 
then Eq. (11.41) can be expressed as 

1 " _1 
X[k] = X R [k] + - £ X R [m]V N [k - m]. (11.44) 

Therefore, 

1 N-l 

jXj[k] = ^Y1 **N*W* ~ ml (11.45) 

which is the desired relation between the real and imaginary parts of the DFS of a 
periodically causal periodic sequence. Similarly, beginning with Eq. (11.38) we can 
show that 

x N-l 

X R [k] = - £ JXi[m}V N [k -m]+ x[0] + (-l) k x[N/2]. (11.46) 

Equations (11.45) and (11.46) relate the real and imaginary parts of the DFS 
representation of the periodic sequence x[n]. If x[n] is thought of as the periodic 
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repetition of a finite-length sequence x[n] as in Eq. (11.31), then 

If x[n] has the "periodic causality" property with respect to a period N (i.e., x[n] =0 
for n < and for n > W/2), then all of the preceding discussion applies to the discrete 
Fourier transform of x[n]. In other words, we can remove the tildes from Eqs. (11.45) 
and (11.46), thereby obtaining the DFT relations 



f 1 N ~ l 
iX f [k]=lN^ XRlm]VNlk ~ m] ' °- k - N -^ 
^ 0, otherwise, 



(11.48) 



and 



. N-l 

-Yl! x dm]Vdk-m]+x[0]+(-l) k x[N/2l 0<k<N-l, (n l 



0, otherwise. 

Note that the sequence V N [k — m] given by Eq. (11.43) is periodic with period TV, so we 
do not need to worry about computing ((k - m)) N in Eqs. (11.48) and (11.49), which 
are the desired relations between the real and imaginary parts of the N-point DFT of a 
real sequence whose actual length is less than or equal to (N/2) + 1 (for N even). These 
equations are circular convolutions, and, for example, Eq. (11.48) can be evaluated 
efficiently by the following procedure: 

1. Compute the inverse DFT of XR[k] to obtain the sequence 

Xep [n]= x[n]+x[ ^ n))N \ 0<n<N-l. (11.50) 

2. Compute the periodic odd part of x[n] by 

C *e P M, < n < N/2, 
x op [n] = I -x ep [n], N/2<n<N-h (11.51) 

[ 0, otherwise. 

3. Compute the DFT of x op [n] to obtain jXi[k], 

Note that if, instead of computing the odd part of x[n] in step 2, we compute 

* ep [0], n = 0, 

*m = <^£m 0< "a/7/ /2, a 1 - 52 ) 

1 J * x ep [N/2], n = N/2, 
0, otherwise, 

then the DFT of the resulting sequence would be X[k], the complete DFT of x[n]. 
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Example 1 1 .3 Periodic Sequence 

Consider a sequence that is periodically causal with period N = 4 and that has 

2, k = 0, 

3, k = 3. 

We can find the imaginary part of the DFT in one of two ways. The first way is to use 
Eq. (11.48). For N = 4, 

{2/, A:=-l + 4m, 
-2/, A:=l+4m, 
0, otherwise, 

where m is an integer. Implementing the convolution in Eq. (11.48) yields 

)X I [k] = -^2x R [k]V 4 [k-m] 

{ 7. * = L 
= { -7. * = 3, 
t 0, otherwise. 

Alternatively, we can follow the three-step procedure that includes Eqs. (11.50) 
and (11.51). Computing the inverse DFT Xfi[k] yields 

x e [n] = -Yl X «W W * kn 

= I[2 + 30r + 4(-l)"+3(-7r] 

( 3, « = 0, 
= { -i, « = 1,3, 

[ 0, « = 2. 

Note that although this sequence is not itself even symmetric, a periodic replication of 
x e [n] is even symmetric. Thus, the DFT X R [k] of x e [n] is purely real. Equation (11.51) 
allows us to find the periodically odd part *opM; specifically, 



^ |, « = 3. 
Finally, we obtain / X[[k] from the DFT of jc op [«]: 

3 

/*/[/c] = £> op [n]Wf 



n=0 

2 4 2 



= -r^+r^ 



7, *=1, 
= < -7, * = 3, 

0, otherwise, 

which is, of course, the same as was obtained from Eq. (11.48). 
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1 1.3 RELATIONSHIPS BETWEEN MAGNITUDE AND PHASE 

So far, we have focused on the relationships between the real and imaginary parts of the 
Fourier transform of a sequence. Often, we are interested in relationships between the 
magnitude and phase of the Fourier transform. In this section, we consider the conditions 
under which these functions might be uniquely related. While it might appear on the 
surface that a relationship between real and imaginary parts implies a relationship 
between magnitude and phase, that is not the case. This is clearly demonstrated by 
Example 5.11 in Section 5.4. The two system functions Hi(z) and H2(z) in that example 
were assumed to correspond to causal, stable systems. Therefore, the real and imaginary 
parts of H\(e jco ) are related through the Hilbert transform relations of Eqs. (11.28) and 
(11.29), as are the real and imaginary parts of H2(e J( °). However, <H\(e j0) ) could not 
be obtained from | H\{e j0) )\, since H\(e j( °) and Hiie^) have the same magnitude but a 
different phase. 

The Hilbert transform relationship between the real and imaginary parts of the 
Fourier transform of a sequence x[n] was based on the causality of x[n\. We can obtain 
a Hilbert transform relationship between magnitude and phase by imposing causality 
on a sequence x[n] derived from x[n] for which the Fourier transform X(e }io ) is the 
logarithm of the Fourier transform of x[n]. Specifically, we define x[n] so that 

x[n] +^+ X(e i(0 ) = \X(e j( °)\e jar ^ x{et ^\ (11.53a) 

%[n\ JL> X(e j< °), (11.53b) 

where 

X(en = \og[X(en] = log |*(*HI + ;arg[*(«?'")] (11.54) 

and, as defined in Section 5.1, aTg[X(e ja} )] denotes the continuous phase of X(e j( °). The 
sequence x[n] is commonly referred to as the complex cepstrum of x[ri\. (See Oppenheim 
et al., 1968 and Oppenheim and Schafer, 1975.) 

If we now require that x[n] be causal, then the real and imaginary parts of X(e^), 
corresponding to \og\X(e j< °)\ and arg[A r (e ; ' ft 0], respectively, will be related through 
Eqs. (11.28) and (11.29); i.e., 

argWO] = ~V f log|*(<?''*)|cot (^^) d6 (11.55) 

and 

log \X(en\ =jt[0] + ±vj* arg[X(^)]cot (^) dO, (11.56a) 

where, in Eq. (11.56a), x[0] is 

*[0] = — f \og\X(e ja} )\do). (11.56b) 

27T J_„ 

Although it is not at all obvious at this point, in Problem 11.32 we develop the fact 
that the minimum-phase condition defined in Section 5.6, namely, that X(z) have all 
its poles and zeros inside the unit circle, guarantees causality of the complex cepstrum. 
Thus, the minimum-phase condition in Section 5.6 and the condition of causality of 
the complex cepstrum turn out to be the same constraint developed from different 
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perspectives. Note that when x[n] is causal, arg[A r (e'* (y )] is completely determined 
through Eq. (1 1.55) by log | X{e }w )\\ however, the complete determination of log | X(e^) | 
by Eq. (11.56) requires both the phase aig[X(e^)] and the quantity x[0]. If x[0] is not 
known, then log\X(eJ° > )\ is determined only to within an additive constant, or equiva- 
lent^, \X(e* a) )\ is determined only to within a multiplicative (gain) constant. 

Minimum phase and causality of the complex cepstrum are not the only constraints 
that provide a unique relationship between the magnitude and phase of the Fourier 
transform. As one example of another type of constraint, it has been shown (Hayes 
et al., 1980) that if a sequence is of finite length and if its z-transform has no zeros in 
conjugate reciprocal pairs, then, to within a scale factor, the sequence (and consequently, 
also the magnitude of the Fourier transform) is uniquely determined by the phase of 
the Fourier transform. 

1 1 A HILBERT TRANSFORM RELATIONS 
FOR COMPLEX SEQUENCES 

Thus far, we have considered Hilbert transform relations for the Fourier transform of 
causal sequences and the discrete Fourier transform of periodic sequences that are "pe- 
riodically causal" in the sense that they are zero in the second half of each period. In this 
section, we consider complex sequences for which the real and imaginary components 
can be related through a discrete convolution similar to the Hilbert transform relations 
derived in the previous sections. These relations are particularly useful in representing 
bandpass signals as complex signals in a manner completely analogous to the analytic 
signals of continuous-time signal theory. 

As mentioned previously, it is possible to base the derivation of the Hilbert trans- 
form relations on a notion of causality or one-sidedness. Since we are interested in 
relating the real and imaginary parts of a complex sequence, one-sidedness will be ap- 
plied to the Fourier transform of the sequence. We cannot, of course, require that the 
Fourier transform be zero for a> < 0, since it must be periodic. Instead, we consider 
sequences for which the Fourier transform is zero in the second half of each period; i.e., 
the z-transform is zero on the bottom half (— n < a) < 0) of the unit circle. Thus, with 
x[n] denoting the sequence and X(e^ a ) its Fourier transform, we require that 

X(e j(O ) = 0, -7r<w<0. (11.57) 

(We could just as well assume that X(e JQ) ) is zero for < a> < tz .) The sequence x[n] 
corresponding to X(e^) must be complex, since, if x[n] were real, X(e ia> ) would be 
conjugate symmetric, i.e., X(e^) = X*{e~^). Therefore, we express x[n] as 

x[n] = x r [n] + jXi[n] t (11.58) 

where x r [n] and xi[n] are real sequences. In continuous-time signal theory, the com- 
parable signal is an analytic function and thus is called an analytic signal. Although 
analyticity has no formal meaning for sequences, we will nevertheless apply the same 
terminology to complex sequences whose Fourier transforms are one sided. 

If X r (e JO} ) and X i (e^ co ) denote the Fourier transforms of the real sequences x r [n] 
and *,■[«], respectively, then 

X(e ja) ) = X r (e jw ) + jXiie* '), (11.59a) 
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and it follows that 

X r (e ja) ) = hx(e }{0 ) + X*(e~ jw )] (11.59b) 

and 

jXfcn = \[X(en - X*(e-n]. (11.59c) 

Note that Eq. (11.59c) gives an expression for jXi(e jw ), which is the Fourier 
transform of the imaginary signal ]Xi[ri\. Note also that X r {e^ w ) and Xi(e jw ) are both 
complex-valued functions in general, and the complex transforms X r (e* w ) and jXi(e ja> ) 
play a role similar to that played in the previous sections by the even and odd parts, re- 
spectively, of causal sequences. However, X r (e }0} ) is conjugate symmetric, i.e., X r (e^) = 
X*{e~ j<v ). Similarly, j Xi(e i<1} ) is conjugate antisymmetric, i.e., ]Xi(e j( °) = -jX?(e- ja) ) t 

Figure 1 1.4 depicts an example of a complex one-sided Fourier transform of a com- 
plex sequence x[n] = x r [n] + y'jc, [n] and the corresponding two-sided transforms of the 
real sequences x r [n] and Xj[n]. This figure shows pictorially the cancellation implied by 
Eqs. (11.59). 

If X(e^) is zero for — n < co < 0, then there is no overlap between the nonzero 
portions of X(e jaj ) and X*(e~^). Thus, X(e jto ) can be recovered from either X r (e^) 
or Xi(e^ a} ). Since X(e^ 0J ) is assumed to be zero at co = ±tt, X(e^) is totally recoverable 
from jXi(e ja) ). This is in contrast to the situation in Section 11.2, in which the causal 
sequence could be recovered from its odd part except at the endpoints. 

In particular, 

X(en=ll X ' (ei% °* a > < *' (11.60) 

v J j 0, -n < co < 0, v f 



and 



X(en = {V X ^ >W) ' ° **>**> (11.61) 

v ' ' 0, -7t < CO < 0. v ' 



Alternatively, we can relate X r (e jto ) and Xi(e ito ) directly by 

Mei») = l-! X ;V?' °<»<*> (11.62) 

\]X r (e }Q) ), -7T < co < 0, v ' 

or 

Xi(e* w ) = H(e ja) )X r (e jco ), (11.63a) 

where 

H(e^) = [~ j ' 0<w<7r ' (11.63b) 

v ' [ y, — 7T < CO < 0. v ' 

Equations (11.63) are illustrated by comparing Figures 11.4(c) and 11.4(d). Now 
Xi(e j< °) is the Fourier transform of *,■[«], the imaginary part of x[n], and X r (e j( °) is the 
Fourier transform of x r [n], the real part of x[n]. Thus, according to Eqs. (11.63), x\n\ 
can be obtained by processing x r [n] with a linear time-invariant discrete-time system 
with frequency response H(e Jto ), as given by Eq. (11.63b). This frequency response has 
unity magnitude, a phase angle of — tt/2 for < co < n, and a phase angle of +7r/2 for 
— it < co < 0. Such a system is called an ideal 90-degree phase shifter. Alternatively, 
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*,v™) 




(d) 

Figure 11.4 Illustration of decomposition of a one-sided Fourier transform. (Solid 
curves are real parts and dashed curves are imaginary parts.) 



when it is clear that we are considering an operation on a sequence, the 90-degree phase 
shifter is also called a Hilbert transformer. From Eqs. (11.63), it follows that 



Xr{en = H^) Xi{ei<0) = -^ / '")^(^). 



(11.64) 



Thus, — x r [n] can also be obtained from jc ( - [n] with a 90-degree phase shifter. 

The impulse response h[n\ of a 90-degree phase shifter, corresponding to the 
frequency response H(e^) given in Eq. (11.63b), is 

If . 1 r 

2n J_ n 2tt Jo 
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or 



2 sin 2 (7r«/2) 

h W = \ n n 

0, 



n = 0. 



(11.65) 



The impulse response is plotted in Figure 11.5. Using Eqs. (11.63) and (11.64), we obtain 
the expressions 



X([n] = >J h[n — m]x r [m] 



(11.66a) 



and 



x r [n] = - Y^ h[n — m]xi[m]. (11.66b) 

m=— co 

Equations (11.66) are the desired Hilbert transform relations between the real 
and imaginary parts of a discrete-time analytic signal. 

Figure 11.6 shows how a discrete- time Hilbert transformer system can be used to 
form a complex analytic signal, which is simply a pair of real signals. 

2 

i — 

it 



_7 _5 _3 -i 
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5tt - 



3tt 
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f ^ 7tt 
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Figure 11.5 impulse response of an 
ideal Hilbert transformer or 90-degree 
phase shifter. 
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Figure 11.6 Block diagram 
representation of the creation of a 
complex sequence whose Fourier 
transform is one sided. 



1 1 .4.1 Design of Hilbert Transformers 

The impulse response of the Hilbert transformer, as given in Eq. (1 1 .65), is not absolutely 
summable. Consequently, 



H(el") = £ h[n]e~' 



-icon 



(11.67) 



converges to Eq. (11.63) only in the mean-square sense. Thus, the ideal Hilbert trans- 
former or 90-degree phase shifter takes its place alongside the ideal lowpass filter and 
ideal bandlimited differentiator as a valuable theoretical concept that corresponds to a 
noncausal system and for which the system function exists only in a restricted sense. 

Approximations to the ideal Hilbert transformer can, of course, be obtained. FIR 
approximations with constant group delay can be designed using either the window 
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method or the equiripple approximation method. In such approximations the 90-degree 
phase shift is realized exactly, with an additional linear phase component required for a 
causal FIR system. The properties of these approximations are illustrated by examples 
of Hilbert transformers designed with Kaiser windows. 



Example 1 1 .4 Kaiser Window Design of Hilbert 
Transformers 

The Kaiser window approximation for an FIR discrete Hilbert transformer of order 
M (length M + 1) would be of the form 

' I {fi(l - [(/i - n d )/n d ] 2 y/ 2 } f 2 s\n 2 [7T(n - n d )/2] \ Q< <M 
h[n]={ I o (0) \tt n-n d J' - * - > 



0, 



otherwise, 

(11.68) 
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Figure 11 .7 (a) Impulse response and (b) magnitude response of an FIR Hilbert 
transformer designed using the Kaiser window. (M = 18 and p = 2.629.) 
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where rid = Af/2. If M is even, the system is a type III FIR generalized linear-phase 
system, as discussed in Section 5.7.3. 

Figure 11.7(a) shows the impulse response, and Figure 11.7(b) shows the magni- 
tude of the frequency response, for M = 18 and $ = 2.629. Because h[n] satisfies the 
symmetry condition h[n] = —h[M — n] for < n < M, the phase is exactly 90° plus a 
linear component corresponding to a delay of n^ = 18/2 = 9 samples; i.e., 



<H(en = -£--%>, 



< CO < 71. 



(11.69) 



From Figure 11.7(b), we see that, as required for a type III system, the frequency 
response is zero at z — 1 and z = -1 (co = and to = n ). Thus, the magnitude response 
cannot approximate unity very well except in some middle band col < M < coh- 

If M is an odd integer, we obtain a type IV system, as shown in Figure 11.8, 
where M = 17 and ^ = 2.44. For type IV systems, the frequency response is forced 




10 15 

Sample number (n) 
(a) 



20 




0.4tt 0.6tt 

Radian frequency (to) 

(b) 



Figure 11.8 (a) Impulse response and (b) magnitude response of an FIR Hilbert 
transformer designed using the Kaiser window. {M = 17 and £ = 2.44.) 
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to be zero only at z = 1 (o) = 0). Therefore, a better approximation to a constant- 
magnitude response is obtained for frequencies around a> = n. The phase response 
is exactly 90° at all frequencies plus a linear phase component corresponding to rid = 
17/2 = 8.5 samples delay; i.e., 



<H(e jw ) = —■- 8.5a). 



(11.70) 



From a comparison of Figures 11.7(a) and 11.8(a), we see that type III FIR Hilbert 
transformers have a significant computational advantage over type IV systems when 
it is not necessary to approximate constant magnitude at a> = jr. This is because, for 
type III systems, the even-indexed samples of the impulse response are all exactly zero. 
Thus, taking advantage of the antisymmetry in both cases, the system with M = 17 
would require eight multiplications to compute each output sample, while the system 
with M = 18 would require only five multiplications per output sample. 



Type III and IV FIR linear-phase Hilbert transformer approximations with 
equiripple magnitude approximation and exactly 90° phase can be designed using the 
Parks-McClellan algorithm as described in Sections 7.4 and 7.5, with the expected im- 
provements in magnitude approximation error over window-designed filters of 
the same length (Rabiner and Schafer, 1974). 

The exactness of the phase of type III and IV FIR systems is a compelling motiva- 
tion for their use in approximating Hilbert transformers. IIR systems must have some 
phase response error as well as magnitude response error in approximating a Hilbert 
transformer. The most successful approach to designing IIR Hilbert transformers is to 
design a "phase splitter," which consists of two all-pass systems whose phase responses 
differ by approximately 90° over some portion of the band < \co\ < n. Such systems 
can be designed by using the bilinear transformation to transform a continuous-time 
phase-splitting system to a discrete-time system. (For an example of such a system, see 
Gold et al. (1970).) 

Figure 11.9 depicts a 90-degree phase -splitting system. If x r [n\ denotes a real input 
signal and Xi[n] its Hilbert transform, then the complex sequence x[n] = x r [n] + jxi[n\ 
has a Fourier transform that is identically zero for —n < a) < 0; i.e., X(z) is zero 
on the bottom half of the unit circle of the z-plane. In the system of Figure 11.6, a 
Hilbert transformer was used to form the signal *,■[«] from x r [n]. In Figure 11.9, we 
process x r [n] through two systems: Hi(e }( °) and H 2 (e }co ). Now, if Hi(e jco ) and H 2 (e ]( °) 
are all-pass systems whose phase responses differ by 90°, then the complex signal y[n] = 
y r [n] + jyi[ri] has a Fourier transform that also vanishes for — n < co < 0. Furthermore, 
| Y(eJ co ) | = | X(e jco ) | , since the phase-splitting systems are all-pass systems. The phases of 
Y(e ico ) and X(e jco ) will differ by the phase component common to Hi (e jw ) and H 2 (e j( °). 
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Complex Figure 11.9 Block diagram 
signal representation of the all-pass phase 
y[ n ] splitter method for the creation of a 
complex sequence whose Fourier 
transform is one sided. 
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1 1 .4.2 Representation of Bandpass Signals 

Many of the applications of analytic signals concern narrowband communication. In 
such applications, it is sometimes convenient to represent a bandpass signal in terms of 
a lowpass signal. To see how this may be done, consider the complex lowpass signal 

x[n] =x r [n] + jXi[n], 

where X( [n] is the Hilbert transform of x r [n] and 

X(e* a ) =0, -n < co < 0. 

The Fourier transforms X r {e i<0 ) and j Xi(e ja) ) are depicted in Figures 11.10(a) and 
11.10(b), respectively, and the resulting transform X(e jco ) = X r (e ja) ) + jXi(e ja) ) is 
shown in Figure 11.10(c). (Solid curves are real parts and dashed curves are imaginary 
parts.) Now, consider the sequence 

s[n] = x[n]e'<* n = s r [n] + j Si [n], (11.71) 

where s r [n] and s ( - [n] are real sequences. The corresponding Fourier transform is 

S(et a ) = X(e iio, - Wc) ) 1 (11.72) 

which is depicted in Figure 11.10(d). Applying Eqs. (11.59) to S(e ju} ) leads to the equa- 
tions 

S r (e ia ) = \[S(e> a ) + S*(e->°>)1 (11.73a) 

jSi(e^) = \[S(e^) - S m (e->°>)]. (11.73b) 

For the example of Figure 11.10, S r (e^ w ) and jSi(e j< °) are illustrated in Figures 11.10(e) 
and 11.10(f), respectively. It is straightforward to show that if X r (e* w ) = for A&> < 
\co\ < 7i, and if co c + Aco < n, then S{e j( °) will be a one-sided bandpass signal such that 
S{ei w ) = except in the interval co c < co < co c + Aco. As the example of Figure 11.10 
illustrates, and as can be shown using Eqs. (11.58) and (11.59), S,-(e' Vu ) = H(e jw )S r {e^\ 
or, in other words, Si[n] is the Hilbert transform of s r [n]. 

An alternative representation of a complex signal is in terms of magnitude and 
phase; i.e., x[n] can be expressed as 

x[n] = A[n]e J + [n K (11.74a) 

where 

A[n] = tf[n] + x, 2 [«]) 1/2 (11.74b) 

and 

<P[n] = arctan f^T) . (11.74c) 

Therefore, from Eqs. (11.71) and (11.74), we can express s[n] as 

s[n] = (x r [n] + jXi[n])e^ n (11.75a) 

= A[n]e } ^ n+ *W\ (11.75b) 
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Figure 11 .10 Fourier transforms for representation of bandpass signals. (Solid 
curves are real parts and dashed curves are imaginary parts.) (Note that in parts b 
and f the functions yX/(e^) and j$j{e ia> ) are plotted, where X/(e' w ) and S/(e^) 
are the Fourier transforms of the Hilbert transforms of *, [n] and s, [n], respectively. ) 



from which we obtain the expressions 

s r [n] = x r [n] cos co c n — jc, [«] sin ft> c «, 
or 

s r [n] = A[n] cos(co c n + <t>[n\), 



(11.76a) 
(11.76b) 
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and 



Sj[n] = x r [n] sin a) c n + jc, [n] cos a) c n, 



(11.77a) 



or 



S([n] = A[n] sm(a> c n + <t>[n]). 



(11.77b) 



Equations (11.76a) and (11.77a) are depicted in Figures 11.11(a) and 11.11(b), 
respectively. These diagrams illustrate how a complex bandpass (single-sideband) signal 
can be formed from a real lowpass signal. 

Taken together, Eqs. (11.76) and (11.77) are the desired time-domain representa- 
tions of a general complex bandpass signal s [n] in terms of the real and imaginary parts 
of a complex lowpass signal x[n]. Generally, this complex representation is a convenient 
mechanism for representing a real bandpass signal. For example, Eq. (11.76a) provides 
a time-domain representation of the real bandpass signal in terms of an "in-phase" com- 
ponent x r [n] and a "quadrature" (90-degree phase-shifted) component jc,- [n]. Indeed, as 
illustrated in Figure 11.10(e), Eq. (11.76a) permits the representation of real bandpass 
signals (or filter impulse responses) whose Fourier transforms are not conjugate sym- 
metric about the center of the passband (as would be the case for signals of the form 
x r [n] cos a> c n). 

It is clear from the form of Eqs. (11.76) and (11.77) and from Figure 11.11 that 
a general bandpass signal has the form of a sinusoid that is both amplitude and phase 
modulated. The sequence A[n] is called the envelope and <f)[n] the phase. This narrow- 
band signal representation can be used to represent a variety of amplitude and phase 
modulation systems. The example of Figure 11.10 is an illustration of single-sideband 
modulation. If we consider the real signal s r [n] as resulting from single-sideband mod- 
ulation with the lowpass real signal x r [n] as the input, then Figure 11.11(a) represents a 



COS (OM 



sin a) r n 



x r [n] 



Hilbert 
transformer 




+ l *■* 

_ s r [n] x r [n] 




Hilbert 
transformer 







sin a>^n 



cos to^n 



(a) 



(b) 



Figure 11.11 Block diagram representation of Eqs. (11.76a) and (11.77a) for 
obtaining a single-sideband signal. 
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scheme for implementing the single-sideband modulation system. Single-sideband mod- 
ulation systems are useful in frequency-division multiplexing, since they can represent 
a real bandpass signal with minimum bandwidth. 



11.4.3 Bandpass Sampling 

Another important use of analytic signals is in the sampling of bandpass signals. In 
Chapter 4 we saw that, in general, if a continuous-time signal has a bandlimited Fourier 
transform such that S c (j£l) = for |£2| > Q^, then the signal is exactly represented 
by its samples if the sampling rate satisfies the inequality 2n/ T > 2£2 N . The key to the 
proof of this result is to avoid overlapping the replicas of S c (jQ) that form the discrete- 
time Fourier transform of the sequence of samples. A bandpass continuous-time signal 
has a Fourier transform such that S c (j Q) = for < |£2| < £2 C and for \Q\ > £l c + AQ. 
Thus, its bandwidth, or region of support, is really only 2 A £2 rather than 2(Q C + AQ), 
and with a proper sampling strategy, the region -Q c < £2 < Q c can be filled with images 
of the nonzero part of S c (jQ) without overlapping. This is greatly facilitated by using a 
complex representation of the bandpass signal. 

As an illustration, consider the system of Figure 11.12 and the signal shown in 
Figure 11.13(a). The highest frequency of the input signal is Q c + AQ. If this signal is 
sampled at exactly the Nyquist rate, 2n/ T = 2(Q C + A £2), then the resulting sequence 
of samples, s r [n] = s c (nT), has the Fourier transform S r (e JQJ ) plotted in Figure 11.13(b). 
Using a discrete-time Hilbert transformer, we can form the complex sequence s[n] = 
s r [n] + js,[n] whose Fourier transform is S(e JCO ) in Figure 11.13(c). The width of the 
nonzero region of S{e^) is Aw = ( AQ)T. Defining M as the largest integer less than or 
equal to 2ti/Aco 7 we see that M copies of S{e^) would fit into the interval — it < co < n. 
(In the example of Figure 11.13(c), 2n/ 'Aw = 5.) Thus, the sampling rate of s[n] can 
be reduced by decimation as shown in Figure 11.12, yielding the reduced-rate complex 
sequence Sd[n] = s Td [n] + y'^dM = s[M/r] whose Fourier transform is 



S d (e joJ ) = — V S(e j[{w - 2nk)/M] ). 
M t—' 

k=0 



(11.78) 
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Figure 11.12 System for reduced-rate sampling of a real bandpass signal by 
decimation of the equivalent complex bandpass signal. 
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(d) 

Figure 11.13 Example of reduced-rate sampling of a bandpass signal using the 
system of Figure 11.12. (a) Fourier transform of continuous-time bandpass signal, 
(b) Fourier transform of sampled signal, (c) Fourier transform of complex bandpass 
discrete-time signal derived from the signal of part (a), (d) Fourier transform of 
decimated complex bandpass of part (c). (Solid curves are real parts and dashed 
curves are imaginary parts.) 
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Figure 11.13(d) shows S d (e ja) ) with M = 5 in Eq. (1 1.78). S(e jo} ) and two of the frequency- 
scaled and translated copies of S(e }oi ) are indicated explicitly in Figure 11.13(d). It is 
clear that aliasing has been avoided and that all the information necessary to reconstruct 
the original sampled real bandpass signal now resides in the discrete-time frequency 
interval —n < oj < jr. A complex filter applied to sa[n] can transform this information 
in useful ways, such as by further bandlimiting, amplitude or phase compensation, etc., 
or the complex signal can be coded for transmission or digital storage. This processing 
takes place at the low sampling rate, and this is, of course, the motivation for reducing 
the sampling rate. 

The original real bandpass signal s r [n] can be reconstructed ideally by the following 
procedure: 

1. Expand the complex sequence by a factor M\ i.e., obtain 

**■ J [0, otherwise. ^ ' ^ 

2. Filter the signal s e [n] using an ideal complex bandpass filter with impulse response 
hi [n] and frequency response 

( 0, — n < oj < <o c , 
Hi(e ja> ) = I M, w c <w<w c + Aw, (11.80) 

^ 0, o) c 4- Aco < (o < jr. 

(In our example, co c + Aco = jr.) 

3. Obtain s r [n] = 7£e{$ e [/i] * /»/[«]}. 

A useful exercise is to plot the Fourier transform S e (e j< °) for the example of 
Figure 11.13 and verify that the filter of Eq. (11.80) does indeed recover s[n]. 

Another useful exercise is to consider a complex continuous-time signal with a 
one-sided Fourier transform equal to S c (jQ.) for Q > 0. It can be shown that such a 
signal can be sampled with sampling rate 2tz/T = AQ, directly yielding the complex 
sequence Sd[n]. 

11.5 SUMMARY 

In this chapter, we have discussed a variety of relations between the real and imaginary 
parts of Fourier transforms and the real and imaginary parts of complex sequences. 
These relationships are collectively referred to as Hilbert transform relationships. Our 
approach to deriving all the Hilbert transform relations was to apply a basic causality 
principle that allows a sequence or function to be recovered from its even part. We 
showed that, for a causal sequence, the real and imaginary parts of the Fourier trans- 
form are related through a convolution-type integral. Also, for the special case when the 
complex cepstrum of a sequence is causal or, equivalently, both the poles and zeros of 
its z- transform lie inside the unit circle (the minimum-phase condition), the logarithm 
of the magnitude and the phase of the Fourier transform are a Hilbert transform pair 
of each other. 

Hilbert transform relations were derived for periodic sequences that satisfy a 
modified causality constraint and for complex sequences whose Fourier transforms 
vanish on the bottom half of the unit circle. Applications of complex analytic signals to 
the representation and efficient sampling of handpass signals were also discussed. 
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PROBLEMS 



Basic Problems with Answers 

11.1. Consider a sequence x[n] with discrete-time Fourier transform X(e^). The sequence x[n] 
is real valued and causal, and 

Tle{X{e j0} )} = 2 -la cos co. 

Determine Jm{X(e^)}. 

11.2. Consider a sequence x[n] and its discrete-time Fourier transform X(e^). The following 
is known: 

x[n] is real and causal, 
ne{X(e>")} = I -cosw. 

Determine a sequence x[n] consistent with the given information. 

11.3. Consider a sequence x[n] and its discrete-time Fourier transform X(e^). The following 
is known: 

x[n] is real, 

jc[0] = 0, 

Jc[l] > 0, 

\X(e ja) )\ 2 = f -costo. 

Determine two distinct sequences x\[n] and X2[n] consistent with the given information. 

11.4. Consider a complex sequence x[n] — x r [n] + ;'x ; [n], where x r [n] and jc, [n] are the real part 
and imaginary part, respectively. The ^-transform X(z) of the sequence x[n] is zero on the 
bottom half of the unit circle; i.e., X(e }aj ) = for n < co < 2tt. The real part of x[n] is 

f 1/2, n = 0, 
x r [n]= I -1/4, n = ±2, 

( 0, otherwise. 

Determine the real and imaginary parts of X(ei w ). 

11.5. Find the Hilbert transforms Xj[n] = Tt{x r [n]} of the following sequences: 

(a) x r [n] — coscoQn 

(b) x r [n] = sin toon 
sin(a) c n) 



(c) x r [n] = 



Ttn 



11.6. The imaginary part of X(e^) for a casual, real sequence x[n] is 

Xi(e Ia> ) = 2 sin <o - 3 sin 4tD. 

Additionally, it is known that X(e 1(a )\ (0= ^ = 6. Find x[n]. 

11.7. (a) x[n] is a real, causal sequence with the imaginary part of its discrete-time Fourier 

transform X{e^) given by 

Jm{X(e ja> )) =sma)-V2sin2a). 
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(b) Is your answer to Part (a) unique? If so, explain why. If not, determine a second, 
distinct choice for x[n] satisfying the relationship given in Part (a). 

11.8. Consider a real, causal sequence x[n] with discrete-time Fourier transform X{e^) = 
X^e^) -f iXi(e^). The imaginary part of the discrete-time Fourier transform is 

A}(e yo, ) = 3sin(2G>). 

Which of the real parts XR m (e }<1) ) listed below are consistent with this information: 

**i(0 = 5cos(2a>), 

X« 2 (eH= -3cos(2a>)-l, 
*»(«?'") = -3 cos(2a>), 

Xk 4 (0 = 2cos(3o>), 

*«(0 = jCOs(2a>) + l. 

11.9. The following information is known about a real, causal sequence x[n] and its discrete-time 
Fourier transform X(e^): 

Jm{X{e jto )} = 3sin(o>) + sin(3<»), 

X(e* a )\ m = 3. 

Determine a sequence x[n] consistent with this information. Is the sequence unique? 

11.10. Consider h[n], the real-valued impulse response of a stable, causal LTI system with fre- 
quency response H(e^). The following is known: 
(i) The system has a stable, causal inverse. 

5 



2 4 



(ii) \H(ei")\ = 



t — COS (O 



5+4 cos co 
Determine h[n] in as much detail as possible. 

11.11. Let x[n] = x r [n] + jxt[n] be a complex-valued sequence such that X(e^) = for 
—it < a) < 0. The imaginary part is 

J 4, « = 3, 
*M = (-4, « = -3. 

Specify the real and imaginary parts of X(e Jai ). 

11.12. /i[/t] is a causal, real-valued sequence with h[0] nonzero and positive. The magnitude 
squared of the frequency response of h[n] is given by 

l"(e'' < ")| 2 = y-5 c °s(«>)- 

(a) Determine a choice for h[ri\. 

(b) Is your answer to Part (b) unique? If so, explain why. If not, determine a second, 
distinct choice for h[n] satisfying the given conditions. 

11.13. Let x[n] denote a causal, complex- valued sequence with Fourier transform 

X(e>°>) = X R (en + jXi(en. 
If X R {e^) = 1 + cos(<w) -f- sin(a>) - sin(2<w), determine Xi(e'<»). 

11.14. Consider a real, anticausal sequence x[n] with discrete-time Fourier transform X(e JQ) ). 
Tlie real part of X(e^) is 

oo 

J^(c^) = ^(l/2) k oos(/aw)- 

fc=0 
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Find X/(ei w ), the imaginary part of X(e^ w ). (Remember that a sequence is said to be 
anticausal if x[n] = for n > 0.) 

11.15. x[n] is a real, causal sequence with discrete-time Fourier transform X(e io} ). The imaginary 
part of X{e^) is 

and it is also known that 



J2 *w = 3 - 



Determine x[n]. 

11.16. Consider a real, causal sequence x[n] with discrete-time Fourier transform X(e^ a> ) 1 where 
the following two facts are given about X(e J ' eo ): 

X R {e jw ) = 2-4cos(3w), 

X(ei m )\ te=n = 7. 

Are these facts consistent? That is, can a sequence x[n] satisfy both? If so, give one choice 
for x[n\. If not, explain why not. 

11.17. Consider a real, causal, finite-length signal x[n] with length N = 2 and with a 2-point 
discrete-Fourier transform X [k] = X R [k]+ j X^/c^ot k = 0, l.If X R [k] = 2$[k]-4S[k-l], 
is it possible to determine x[n] uniquely? If so, give x[n]. If not, give several choices for 
x[n] satisfying the stated condition on A7i[&]. 

11.18. Let x[n] be a real-valued, causal, finite-length sequence with length N = 3. Find two 
choices for x[n] such that the real part of the discrete Fourier transform X R [k] matches 
that shown in Figure PI 1.18-1. Note that only one of your sequences is "periodically causal" 
according to the definition in Section 11.2, where x[n] = for N/2 < n < N — 1. 



X R [k] 



o i 2 k Figure P11. 18-1 

11.19. Let x[n] be a real, causal, finite-length sequence with length N = 4 that is also periodically 
causal. The real part of the 4-point discrete Fourier transform X R [k] for this sequence is 
shown in Figure Pll.19-1. Determine the imaginary part of the DFT ; Xj[k], 



X R [k] 



H_U1 



12 3k Figure P11.19-1 

11.20. Consider a sequence x[n] that is real, causal, and of finite length with N = 6. The imaginary 
part of the 6-point discrete Fourier transform of this sequence is 

-/2/V3, k = 2, 
jXi[k] = { /2/V3, k = 4, 

0, otherwise. 
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Additionally, it is known that 



*$>[*] = !■ 



*=0 



Which of the sequences shown in Figure PI 1.20-1 are consistent with the information 
given? 



*iM 



2/3 • 

2 

-• 1 1 • — • — •- 

1 3 4 5 n 

-2/3* 



*3W 



2/3| 

2 

■ 1 • — • — •- 



-2/3* 



3 4 5 n 



1 1 x 5 [n] 



1 3 4 5 n 

-2/3 1 

x 7 [n] 



'2/3 



2 3 



1 

-2/3' 



-1* 



4 5 



Z/3t 

5 

-• — * — • ' 1 • — » 

1- 



x 2 [n] 



12 3 4| n 

-2/3 



T6 



1 



-4* 



3 4 5 



, n , , , 

• — i — ■ — • — • — •- 



n 

-2/3* 



2 3 4 5 



-I 



2/3 



2 3 4 5 

»-2/3 



x 4 [n] 



x 6 [n] 



x 8 [n) 



Figure P1 1.20-1 
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11.21. Let x[n] be a real causal sequence for which \x[n]\ < oo. The z-transform of x[n] is 

oo 

X(z) = ^2x[n]z-», 

n=0 

which is a Taylor's series in the variable z~ l and therefore converges to an analytic function 
everywhere outside some circular disc centered at z = 0. (The region of convergence in- 
cludes the point z = oo, and, in fact, Jf(oo) = x[0].) The statement that X(z) is analytic (in 
its region of convergence) implies strong constraints on the function X(z). (See Churchill 
and Brown, 1990.) Specifically, its real and imaginary parts each satisfy Laplace's equation, 
and the real and imaginary parts are related by the Cauchy-Riemann equations. We will 
use these properties to determine X{z) from its real part when x[n] is a real, finite- valued, 
causal sequence. 

Let the z-transform of such a sequence be 

X(z) = X R (z) + jXj(z). 
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where Xr{z) and X[{z) are real- valued functions of z. Suppose that Xr(z) is 

P 4- ot cos to 
X R (pe^) = — , a real, 

P 

for z = pe jco . Then find X{z) (as an explicit function of z), assuming that X(z) is analytic 

everywhere except at z = 0. Do this using both of the following methods. 

(a) Method 1, Frequency Domain. Use the fact that the real and imaginary parts of X(z) 

must satisfy the Cauchy-Riemann equations everywhere that X(z) is analytic. The 

Cauchy-Riemann equations are the following: 

1. In Cartesian coordinates, 

dU _dV dV _ dU 

dx dy ' dx 3 v ' 

where z = x 4- jy and X(x + jy) = (J(x, y) + ;' V(x, _y). 

2. In polar coordinates, 



dU 1 dV 


dV 


1 dU 


dp p do) 


~dp~~ 


p dco ' 



where z = pe*™ and X(pe^) = £/(p, <u) + ; V(p, w). 

Since we know that V — Xn,we can integrate these equations to find V = X/ and 
hence X. (Be careful to treat the constant of integration properly.) 
(b) Method!, Time Domain. The sequence x[n] can be represented as x[n] =. x e [ri\+x [n\, 
where x e [n] is real and even with Fourier transform Xn{e^) and the sequence x [n] 
is real and odd with Fourier transform jXj(e^). Find x e [n] and, using causality, find 
x [n] and hence x[n] and X(z). 

11.22. Show that the sequence of discrete Fourier series coefficients for the sequence 

ri, « = 0, N/2, 
u N [n] = I 2, n = l,2, ..., N/2-l, 

[o, n = N/2 + l,...,N-l, 

is 

fiV, * = 0, 

f/ N [fc] = 1 -j2col{nk/N), A: odd, 

(o, k even, Jfc ^ 0. 

///nf: Find the z-transform of the sequence 

u N [n] = 2w[n] - 2u[n - N/2] - S[n] + 5[« - 7V/2], 

and sample it to obtain U[k]. 



Advanced Problems 

11.23. Consider a real-valued finite-duration sequence x[n] of length M. Specifically, x[n] = 
for n < and « > Af - 1. Let X [k] denote the Af-point DFT of x[n] with N > M and AT 
odd. The real part of X[k] is denoted Xx[k]. 



Chap.11 Problems 



807 



(a) Determine, in terms of M, the smallest value of N that will permit X [k] to be uniquely 
determined from Aa[£]. 

(b) With N satisfying the condition determined in Part (a), X[k] can be expressed as the 
circular convolution of Xn[k] with a sequence Us[k]. Determine t/#[fc]. 

11.24. Consider a complex sequence h[n] = h r [n] + //*,[«], where h r [n] and hi[n] are both real 
sequences, and let H{e> w ) = Hn^e'* ) + jHi(e ia) ) denote the Fourier transform of h[ri\, 
where Hr^ 01 ) and Hi{e^) are the real and imaginary parts, respectively, of H(e im ). 

Let HER(e ico ) and //or (e^) denote the even and odd parts, respectively, of HR(e }0> ), 
and let //ei(^ /<w ), and Hoi(e }at ) denote the even and odd parts, respectively, of ///(e' w ). 
Furthermore, let //^(e ;w ) and //s(e 7w ) denote the real and imaginary parts of the Fourier 
transform of h r [n], and let Hc(e ico ) and //^(e^) denote the real and imaginary parts of 
the Fourier transform of hi [n]. Express H A (e> m ), H B (e i( °), H c (e^), and H D {ei°>) in terms 
of H ER (en, H OK (e'»), // E i(e> w ), and Hoi(e><»). 

11.25. The ideal Hilbert transformer (90-degree phase shifter) has frequency response (over one 
period) 



H{e }< °) 



-{i 1 - 



co > 0, 
co <0. 



Figure PI 1.25-1 shows H(e i<0 ), and Figure PI 1.25-2 shows the frequency response of an 
ideal lowpass filter H] p (e }0i ) with cutoff frequency co c — tt/2. These frequency responses 
are clearly similar, each having discontinuities separated by tt. 



H(e> m ) 



Figure P1 1.25-1 



-2tt 



H lp (en 



2tt 



Figure P1 1.25-2 



(a) Obtain a relationship that expresses H(e }m ) in terms of H\ v (e JQi ). Solve this equation 
for H ip (e^) in terms of H(e jco ), 

(b) Use the relationships in part (a) to obtain expressions for h[n] in terms of hi v [n] and 
for h\ p [n] in terms of h[n]. 

The relationships obtained in Parts (a) and (b) were based on definitions of ideal systems 
with zero phase. However, similar relationships hold for nonideal systems with generalized 
linear phase. 

(c) Use the results of Part (b) to obtain a relationship between the impulse response 
of a causal FIR approximation to the Hilbert transformer and the impulse response 
of a causal FIR approximation to the lowpass filter, both of which are designed by 
(1) incorporating an appropriate linear phase, (2) determining the corresponding ideal 
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impulse response, and (3) multiplying by the same window of length ( M + 1) samples, 
i.e., by the window method discussed in Chapter 7. (If necessary, consider the cases 
of M even and M odd separately.) 
(d) For the Hilbert transformer approximations of Example 11.4, sketch the magnitude 
of the frequency responses of the corresponding lowpass filters. 

11.26. In Section 11.4.3, we discussed an efficient scheme for sampling a bandpass continuous- 
time signal with Fourier transform such that 

S c (/*ft) = for |ft| < ft c and |ft|>ft c + Aft. 

In that discussion, it was assumed that the signal was initially sampled with sampling 
frequency 2n/ T = 2(ft c + Aft), i.e., at the lowest possible frequency that avoids aliasing. 
The bandpass sampling scheme is depicted in Figure 11.12. After we form a complex 
bandpass discrete-time signal s[n] with one-sided Fourier transform S(e ja> ), the complex 
signal is decimated by a factor M, which is assumed to be the largest integer less than or 
equal to 2tt/( Aft T). 

(a) By carrying through an example such as the one depicted in Figure 11.13, show that if 
the quantity 2jt/( A ft 7) is not an integer for the initial sampling rate chosen, then the 
resulting decimated signal s<i[n] will have regions of nonzero length where its Fourier 
transform Sd(e }co ) is identically zero. 

(b) How should the initial sampling frequency 2nj T be chosen so that a decimation factor 
M can be found such that the decimated sequence s</["] in the system of Figure 11.12 
will have a Fourier transform Sd{e^) that is not aliased, yet has no regions where it is 
zero over an interval of nonzero length? 

11.27. Consider an LTI system with frequency response, 



V ' 10, — JT < CD < 0. 



The input x[n] to the system is restricted to be real valued and to have a Fourier transform 
(i.e., x[n] is absolutely summable). Determine whether or not it is possible to always 
uniquely recover the system input from the system output. If it is possible, describe how. 
If it is not possible, explain why not. 

Extension Problems 

11.28. Derive an integral expression for H(z) inside the unit circle in terms of TZe{ H(e iai )} when 
h[n] is a real, stable sequence such that h[n] = for n > 0. 

11.29. Let TC{'} denote the (ideal) operation of Hilbert transformation; that is, 

oo 

H{x[n]\ = ]T x[k]h[n - k], 

k=—oo 

where h[n] is 

f 2sin 2 (^/2) 

«»H — ™ — ' 

to, n = 0. 

Prove the following properties of the ideal Hilbert transform operator. 
(a) H{H{x[n]}} = -x[n] 



(b) ]P jt[n]ft{jt[n]} = [Hint: Use Parseval's theorem.] 
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(c) H{jt[/i]*_y[n]} = H{jt[/i]}*y[n] = Jc[rt]*H{y[«]}, where jc[«] and y[n] are any sequences. 

11.30. An ideal Hilbert transformer with impulse response 

f 2sin 2 (^/2) 

%H Vn ' "^ 

I 0, n = 0, 

has input x r [n] and output jc,-[/i] = x r [n] * h[n], where x r [n] is a discrete-time random 
signal. 

(a) Find an expression for the autocorrelation sequence <f> XiXi [m] in terms of h[n] and 
<t>x T x T [m\ 

(b) Find an expression for the cross-correlation sequence <f> XrXi [m]. Show that in this case 
4>x T xi [ m ] is a° °dd function of m. 

(c) Find an expression for the autocorrelation function of the complex analytic signal 
x[n] = x r [n] + jxi[n]. 

(d) Determine the power spectrum P xx (co) for the complex signal in Part (c). 

11.31. In Section 11.4.3, we discussed an efficient scheme for sampling a bandpass continuous- 
time signal with Fourier transform such that 

S c (jQ) = for \U\ < Q c and |fi| > Q c + Afi. 

The bandpass sampling scheme is depicted in Figure 11.12. At the end of the section, 
a scheme for reconstructing the original sampled signal s r [n] was given. The original 
continuous-time signal s c (t) in Figure 11.12 can, of course, be reconstructed from s r [n] 
by ideal bandlimited interpolation (ideal D/C conversion). Figure Pll.31-1 shows a block 
diagram of the system for reconstructing a real continuous-time bandpass signal from a 
decimated complex signal. The complex bandpass filter Hi(e }a) ) in the figure has a fre- 
quency response given by Eq. (11.80). 
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Figure P11.31-1 



(a) Using the example depicted in Figure 11.13, show that the system of Figure Pll.31-1 
will reconstruct the original real bandpass signal (i.e., y c (t) = s c (t)) if the inputs to 
the reconstruction system are y r a[n] = s T ^[n] and yid[n] = sa[n]. 

(b) Determine the impulse response hi [n] = hn[n] + jh\i[n] of the complex bandpass filter 
in Figure Pll.31-1. 

(c) Draw a more detailed block diagram of the system of Figure Pll.31-1 in which only 
real operations are shown. Eliminate any parts of the diagram that are not necessary 
to compute the final output. 

(d) Now consider placing a complex linear time-invariant system between the system of 
Figure 11.12 and the system of Figure Pll.31-1. This is depicted in Figure Pll.31-2, 
where the frequency response of the system is denoted H(e ia> ). Determine how H{e iai ) 
should be chosen if it is desired that 



Y c (jQ) = H eff (jn)S c (jn), 



where 



HefiiJQ) 



■{i 



Q c < \Q\ <Sl c + Aft/2, 
otherwise. 
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Figure P1 1.31 -2 

11.32. In Section 11.3, we mention that a causal complex cepstrum x[n] is equivalent to the 
minimum-phase condition of Section 5.4. Remember that x[n] is the inverse Fourier trans- 
form of X{e iu >) as defined in Eq. (1 1 .54). Note that because X{ei a ) and X(e^) are defined, 
the region of convergence of both X(z) and X(z) must include the unit circle. 

(a) Argue that the singularities (poles) of X(z) will occur wherever X(z) has either poles 
or zeros. Use this fact to prove that if Jc [n] is causal, x[n] is minimum phase. 

(b) Argue that if x[n] is minimum phase, the constraints of the region of convergence 
require x[n] to be causal. 

We can examine this property for the case when x[n] can be written as a superposition 
of complex exponentials. Specifically, consider a sequence x[n] whose z-transform is 



Mf 



M 



Ylii-akz^Yia-bkz) 



X(z) = A 



k=l 



k=l 



Ni 



No 



Ylii-ctz'^iid-dkz) 



k=l 



k=l 



where A > and a*, bk, Ck and dk all have magnitude less than one. 

(c) Write an expression for X(z) = log X(z). 

(d) Solve for x[n] by taking the inverse z- transform of your answer in Part (c). 

(e) Based on Part (d) and the expression for X(z), argue that for sequences x[n] of this 
form, a causal complex cepstrum is equivalent to having minimum phase. 
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Absolute summability, 51, 108 
for suddenly-applied 
exponential, 51-52 
Accumulator, 19, 31, 34 
difference equation 

representation of, 34-35 
as time-invariant system, 20 
Adaptive signal processing, 4 
Additivity property, 18 
Aliasing, 144—45 
prefiltering to avoid, 185-87 
in reconstruction of 

undersampled sinusoidal 
signal, 148-49 
sampling/reconstruction of 
sinusoidal signal, 147 
Aliasing distortion, 144—45 
All-pass decomposition, 280-82 
All-pass systems, 274-79 
defined, 274 

first-and second-order, 275 
uses of, 278 
Alternation theorem, 489-91 
Amplitude spectrum, 49 
Analog channel vocoder, 5 
Analog signals, 8 
digital processing of, 185-201 
analog-to-digital (A/D) 

conversion, 187-93 
analysis of quantization 

errors, 193-97 
prefiltering to avoid aliasing, 
185-87 
Analog-to-digital (A/D) 
conversion, 187-93 
oversampled: 
with direct quantization, 

201-5 
with noise shaping, 206-10 
sample-and-hold system, 
188-90 
Analytic signal, 776 
Antialiasing filter, 186 
Aperiodic discrete-time 

sinusoids, 15 
Approximation: 
Butterworth, 458-60 
Chebyshev, 460-63 



elliptic, 463-65 
equiripple, 492-93 
Attenuation, and group delay, 

effects of, 343^5 
Autocorrelation, 65-66 
Autocorrelation invariance, 526 
Autocorrelation sequence: 
of h[n], 67-68 
spectrum analysis of random 

signals using estimates of, 

743^8 
Autocovariance sequence, 65-66 
Autoregressive (AR) linear 

random process, 771 
Autoregressive moving-average 

(ARMA) linear random 

process, 771 
Auxiliary conditions, and 

linearity/time 

invariance/causality of a 

system, 39 
Averaging of periodograms, 

737-38 
computation using the DFT, 

739 

Backward difference, 21, 32, 

33-34 
Bandlimited differentiator, ideal, 

159 
Bandlimited signal, 

reconstruction of, from its 

samples, 150-53 
Bandpass filters, FIR equiripple 

approximation of, 507-10 
Bandpass sampling, 799-801 
Bandpass signals, representation 

of, 796-99 
Bandstop filters, frequency 

response of, 44 
Bartlett windows, 468-71, 744, 

750-54 
Basic sequences/sequence 

operations, 11-16 
combining, 13-16 
exponential sequences, 13-14 
unit sample sequence, 1 1 
unit step sequence, 11-13 



Bilateral z-transform, 95 
Bilinear transformation, 450-54, 
517 
Butterworth approximation, 

458-60 
of a Butterworth filter, 454-57 
Chebyshev approximation, 

460-63 
design examples, 454-65 
elliptic approximation, 463-65 
and warping, 453-54 
Binary number system, 371-74 
Bit-reversed order, 642-43 
Black man window, 468 fn, 469 
Block convolution, 585-87 
overlap-add method of, 723 
using time-dependent Fourier 
transform, 722-23 
Block floating point, 668 
Block diagram representation of 
linear constant-coefficient 
difference equations, 
341^8 
Block processing, 693 
Bounded-input bounded-output 

(BIBO),21 
Butterflies, 676 
Butterworth approximation, 

458-60 
Butterworth filter: 

bilinear transformation of, 

454-57 
impulse invariance with, 
446-49 

Canonic form implementation, 

346, 347 
Cascade connection, 29 
Cascade form structures: 

coefficient quantization effects, 

379-82, 386-90 
FIR systems, 390, 412 
IIR systems, 356-59, 379-82, 
403-10 
Cauchy integral theorem, 776 
Cauchy principal values, 781-82 
Cauchy-Riemann conditions, 776 
Causal all-pass systems, 274-78 
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Causal generalized linear-phase 
systems, 297-311 
type I FIR linear-phase 

systems, 298 
type II FIR linear-phase 

systems, 298 
type III FIR linear-phase 

systems, 298 
type IV FIR linear-phase 
systems, 298-99 
Causality, 21 
and auxiliary conditions, 39 
and region of convergence 
(ROC), 110-11 
Causal sequences, 31, 129, 777-82 
defined, 778 

exponential sequence, 779-80 
finite-length sequence, 779 
sufficiency of Fourier 

transform for, 777-82 
exponential sequence, 

779-80 
finite-length sequence, 779 
Characteristic of floating point 

number, 412 
Charge -coupled devices (CCDs), 

2 
Charge transport devices 

(CTDs), 2 
Chebyshev approximation, 

460-63 
Chirp transform algorithm 
(CTA), 656-61 
parameters, 661 
Circular convolution: 
with delayed impulse 
sequence, 572-73 
and discrete Fourier transform, 

571-75 
Appoint circular convolution, 

571 
of two rectangular pulses, 
573-75 
Circular shift of a sequence, 
discrete Fourier 
transform, 564-67 
Coefficient quantization, 377-39 
of an optimum FIR filter, 

386-90 
in FIR systems, 384-86 
in IIR systems, 377-82 
maintaining linear phase, 

390-91 
poles of quantized 

second-order sections, 
382-84 



Commutative property of 

convolution, 29 
Compensation for zero-order 

hold, 506-7 
Complex-conjugate pole pair, 

direct form 

implementation of, 382-84 
Complex cepstrum, 138, 788-89 
Complex exponential sequences, 

14-15, 40 
Complex sequences: 
defined, 789 
Hilbert transform relations for, 

789-801 
Compressor, 20-21, 167-68 
Computationally realizable 

systems, 242 
Conj ugate-antisymmetric 

sequence, 55-56 
Conjugate-symmetric sequence, 

55-56 
Conjugation property, 

z-transform, 123 
Continuous phase, 343 
Continuous-to-discrete-time 

(C/D) conversion, 141^9 
Continuous-time complex 

exponentials and 

sinusoids, compared to 

discrete-time complex 

exponentials and 

sinusoids, 14 
Continuous-time IIR filter 

design, 442-43 
Continuous-time processing, of 

discrete-time signals, 

163-67 
Continuous-time signals, 8 
aliasing, 144-45 
in reconstruction of 

undersampled sinusoidal 

signal, 148-49 
sampling/reconstruction of 

sinusoidal signal, 147 
bandlimited signal 

reconstruction, from its 

samples, 150-53 
continuous-time processing of 

discrete-time signals, 

163-67 
moving-average system with 

noninteger delay, 165-67 
noninteger delay, 164-65 
digital processing of analog 

signals, 185-201 
analog-to-digital (A/D) 



conversion, 187-93 
analysis of quantization 

errors, 193-97 
digital-to-analog (D/A) 
conversion, 197-201 
prefiltering to avoid aliasing, 
185-87 
discrete-time processing of, 
153-63 
changing sampling rate 

using, 167-78 
impulse invariance, 160-63 
linear time-invariant 
discrete-time systems, 
154-60 
frequency-domain 

representation of, 142-49 
multirate signal processing, 
179-84 
interchange of filtering and 
downsam- 
pling/upsampling, 
179-80 
polyphase decompositions, 

180-82 
polyphase implementation 
of decimation filters, 
182-83 
polyphase implementation 
of interpolation filters, 
183-84 
Nyquist frequency/Nyquist 

rate, 146-47 
periodic sampling, 140-42 
sampling of, 140-239 
sampling rate change by 

noninteger factor, 176-78 
sampling rate increase by 
integer factor, 172-76 
sampling rate reduction by 
integer factor, 167-72 
unit impulse function, 142-43 
Convergence: 
Fourier transform, 50-53 
z-transform, 96, 105-11 
Convolution property, 

z-transform, 124-26 
Convolution of sequences, 22-28 
124-25 
block, 585-88, 721-22 
circular, 571-75 
linear, 576-88 
periodic, 548-50 
Convolution sum: 
analytic evaluation of, 26-28 
computation of, 25-26 
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defined, 23 
Convolution-sum expression, 

23-25 
Convolution theorem, 60-61 
Fourier transform, 60-61 
^-transform, 124—25 
CORDIC rotator algorithm, 677, 

684 
Correlation, computing using 

DFT, 746-^8 
Coupled form, for second-order 

system, 384 
Coupled form oscillator, 425 
Critically sampled filter bank, 770 
Cross-correlation, 69-70 

DB (decibels), 254 
DCT- 1,590-93 
relationship between DFT 

and, 593-94 
See also Discrete cosine 
transform (DCT) 
DCT-2, 590-93 
energy compaction property 

of, 595-98 
relationship between DFT 

and, 594-95 
See also Discrete cosine 
transform (DCT) 
Dead bands, 416 
Decimation, 172 
Decimation filters, polyphase 

implementation of, 182-83 
Decimation-in-frequency 
algorithms, 646-52 
alternate forms, 650-52 
in-place computation, 650 
Decimation-in-time algorithms, 
635^6 
alternate forms, 643-46 
in-place computations, 640-43 
Decimator, 172 
Decomposition: 
all-pass, 280-^82 
of a linear-phase system, 
308-11 
Delay distortion, 242^3 
Deterministic autocorrelation 

sequence, 67-68 
DFS, See Discrete Fourier series 

(DFS) 
DFT, See Discrete Fourier 

transform (DFT) 
Difference equations, recursive 

computation of, 37-38 
Differentiation in frequency, 60 



Differentiation property, 

z -transform, 122-23 
Differentiators, 516 

Kaiser window design of, 
482-85 
Digital filters, 439 
Digital processing of analog 
signals, 185-201 
analog-to-digital (A/D) 
conversion, 187-93 
analysis of quantization errors, 

193-97 
digital-to-analog (D/A) 
conversion, 197-201 
prefiltering to avoid aliasing, 
185-87 
Digital signal processing, 9 
early use of digital computers 
in, 5-6 
Digital signals, 8 
Digital-to-analog (D/A) 

conversion, 185, 197-201 
oversampling and noise 
shaping in, 210-13 
Dirac delta function, 142^43 
Direct form I implementation, of 

an LTI system, 346-48 
Direct form II implementation, 
of an LTI system, 347^8 
Discrete cosine transform 
(DCT), 589-99 
applications of, 598-99 
DCT-1, 590-93 

relationship between DFT 
and, 593-94 
DCT-2, 590-93 

energy compaction property 

of, 595-98 
relationship between DFT 
and, 594-95 
definitions of, 589-90 
multiplication of, 599 
Discrete Fourier series (DFS): 
duality in, 544-^5 
of a periodic impulse train, 544 
of a periodic regular pulse 

train, 545^46 
properties of, 546-51 
duality property, 547 
linearity property, 546 
periodic convolution, 548-51 
shift of a sequence, 546-47 
symmetry properties, 547 
representation of periodic 
sequences, 543-46 



Discrete Fourier transform 

(DFT), 541-692 
autocorrelation sequence, 

spectrum analysis of 

random signals using 

estimates of, 743-48 
chirp transform algorithm 

(CTA), 656-61 
parameters, 661 
computation of, 629-52 
decimation-in-frequency 

algorithms, 646-52 
decimation-in-time 

algorithms, 635-46 
Goertzel algorithm, 633-35 
correlation, computing using 

DFT, 746-^8 
defined, 541 
DFT analysis of sinusoidal 

signals, 697-714 
oversampling/linear 

interpolation for 

frequency estimation, 

713-14 
spectral sampling, 703-14 
with 32 -point Kaiser window 

and zero-padding, 71 1-12 
using a Kaiser window, 

708-10 
windowing, 698-703 
discrete cosine transform 

(DCT), 589-99 
applications of, 598-99 
DCT-1 and DCT-2, 590-93 
definitions of, 589-90 
energy compaction property 

of DCT-2, 595-98 
multiplication of, 599 
relationship between DFT 

and DCT-1, 593-94 
relationship between DFT 

and DCT-2, 594-95 
discrete Fourier series (DFS), 

543^6 
duality in, 544—45 
of a periodic impulse 

training, 544 
of a periodic regular pulse 

train, 545^46 
properties of, 546-51 
fast Fourier transform (FFT) 

algorithms, 629-92 
algorithms for more general 

values of N, 655 
coefficients, 654—55 
indexing, 652-54 
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finite register length, effects of, 

661-68 
Fourier analysis of signals 
using, 693-97 
relationship between DFT 
values, 697 
as Fourier representation of 
finite-duration sequences, 
559-64 
implementation of, using 
convolution, 655-61 
implementing linear 

time-invariant systems 
using, 582-88 
linear convolution, 576-88 
circular convolution as 
linear convolution with 
aliasing, 577-82 
of two finite-length 
sequences, 277 
periodic sequences, 

representation of, 542^46 
of periodic signals, 551-55 
periodogram, 730-42 
averaging of, 737-39 
defined, 732 

explicit computation of, 732 
modified, 732 
periodogram analysis, 731 , 

739-42 
power spectrum, 731-32, 734 
properties of, 733-37 
power spectrum estimation: 
computing using DFT, 

746-48 
example based on estimation 
of autocorrelation 
sequence, 748-54 
properties of, 564-76 
circular convolution, 571-75 
circular shift of a sequence, 

564-67 
duality property, 567-68 
linearity property, 564 
symmetry properties, 568-70 
sampling the Fourier 

transform, 555-59 
time-dependent Fourier 

analysis of nonstationary 
signals, 723-30 
radar signals, 728-30 
speech signals, 720-28 
time-dependent Fourier 
transform, 714-22 
block convolution using, 
722-23 



defined, 714 

effect of the window in, 

717-18 
of a linear chirp signal, 

715-17 
sampling in time/frequency, 
718-22 
Winograd Fourier transform 
algorithm (WFTA), 
655-56 
Discrete Hilbert transforms, 
775-810 
analytic signal, 776, 789 
bandpass sampling, 799-801 
bandpass signals, 

representation of, 796-99 
Cauchy principal values, 

781-82 
causal sequences: 
defined, 778 
exponential sequence, 

779-80 
finite-length sequence, 779 
sufficiency of the Fourier 
transform for, 777-82 
Hilbert transformers, 791 
design of, 792-95 
Kaiser window design of, 
793-95 
Hilbert transform relations, 
775-801 
for complex sequences, 
789-801 
magnitude, relationships 
between phase and, 
788-89 
Poisson's formulas, 776 
Discrete-time differentiators, 

482-85 
Discrete-time filter, determining 
specifications for, 440-42 
Discrete- time Fourier transform 

(DTFT), 48fn 
Discrete-time impulse, 11 
Discrete-time random signals, 

65-70 
Discrete-time signal processing, 2 
continuous signals, 2 
future of, 7 
history of, 6-7 
Discrete-time signals, 8-93 
basic sequences/sequence 
operations, 11-16 
combining basic sequences, 
13-16 



complex exponential 

sequence, 14 
exponential sequences, 

13-14 
sinusoidal sequences, 13 
unit sample sequence, 11 
unit step sequence, 11-13 
defined, 8 

discrete-time systems, 16-22 
graphic depiction of, 10 
sampling frequency, 10 
sampling period, 10 
as sequences of numbers, 9-16 
signal-processing systems, 
classification of, 8-9 
Discrete-time sinusoids, 

periodic/aperiodic, 15 
Discrete-time specifications, 443 
Discrete-time systems, 16-22 
causality, 21 

coefficient quantization, 
377-39 
of an optimum FIR filter, 

386-90 
in FIR systems, 384-86 
in IIR systems, 377-82 
maintaining linear phase, 

390-91 
poles of quantized 
second-order sections, 
382-84 
defined mathematically, 16-17 
discrete-time random signals, 
65-70 
autocorrela- 

tion/autocovariance 
sequence, 65-66 
deterministic 

autocorrelation sequence, 
67-68 
power density spectrum, 68 
random process, 65 
white noise, 69 
finite-precision numerical 
effects, 370-77 
numerical representations, 

371-74 
quantization in 

implementing systems, 
374-77 
FIR systems, basic network 
structures for, 366-70 
cascade form, 367-68 
direct form, 367 
linear-phase FIR system 
structures, 368-70 
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fixed-point realizations of IIR 

digital filters, zero-input 

limit cycles in, 413-18 
Fourier transform theorems, 

58-65 
convolution theorem, 60-61 
differentiation in frequency, 

60 
frequency shifting, 59 
linearity of Fourier 

transform, 59 
modulation or windowing 

theorem, 61-62 
Parseval's theorem, 60 
time reversal, 60 
time shifting, 59 
frequency-domain 

representation of, 40—48 
eigenfunctions for linear 

time-invariant systems, 

40-45, 61 
frequency response of the 

ideal delay system, 41 
frequency response of the 

moving-average system, 

44-45 
ideal frequency-selective 

filters, 43-44 
sinusoidal response of linear 

time-invariant systems, 

42-43 
suddenly-applied complex 

exponential inputs, 46-48 
ideal delay system, 17 
IIR systems, basic structures 

for, 354-63 
cascade form, 356-59 
direct forms, 354-56 
parallel form, 359-61 
instability, 21-22 
testing for, 22 
limit cycles: 
avoiding, 417-18 
due to overflow, 416-17 
due to round-off, 414-16 
due to truncation, 414-16 
in first-order system, 414-16 
linear constant-coefficient 

difference equations, 

34-40 
block diagram 

representation of, 341-48 
difference equation 

representation of the 

accumulator, 34-35 
difference equation 



representation of the 

moving-average system, 

35-36 
recursive computation of 

difference equations, 

37-38 
signal flow graph 

representation of, 348-53 
linear systems, 18 
accumulator system, 19 
nonlinear system, 19 
linear time-invariant systems, 

22-28, 154-60 
convolution sum, 23-28 
eigenfunctions for, 40-45 
properties of, 28-34 
memoryless systems, 18 
moving average, 17-18 
and processing of 

continuous-time signals, 

153 
representation of sequences by 

Fourier transforms, 48-54 
absolute summability for 

suddenly-applied 

exponential, 51-52 
Fourier transform of 

complex exponential 

sequences, 54 
Fourier transform of a 

constant, 53 
inverse Fourier transform, 48 
square-summability for the 

ideal lowpass filter, 52-53 
round-off, limit cycles due to, 

414-16 
round-off noise, 391-413 
analysis of cascade IIR 

structure, 403-10 
analysis of direct-form FIR 

systems, 410-12 
analysis of direct-form IIR 

structures, 391-99 
first-order system, 396-97 
floating-point realizations of 

discrete-time systems, 

412-13 
interaction between scaling 

and, 402-3 
scaling in fixed-point 

implementations of IIR 

systems, 399-403 
second-order system, 397 
sinusoidal response of, 42-43 
stability, 21-22 
testing for, 22 



structures for, 340-438 
symmetric properties of 

Fourier transform, 55-58 
conjugate-antisymmetric 

sequence, 55-56 
conjugate-symmetric 

sequence, 55-56 
even function, 55 
even sequence, 55 
illustration of, 57-58 
odd function, 55 
odd sequence, 55 
time-invariant systems, 20-21 
accumulator as, 20 
compressor system, 20-21 
transposed forms, 363-66 
for a basic second-order 

section, 364-65 
for first-order system with 
no zeros, 363-64 
truncation, limit cycles due to, 
414-16 
Discrete-to-continuous-time 

(D/C) conversion, 152-53 
Distortion compensation, 282-83 
Doppler frequency, 729-30 
Downsampling, 168-72 
interchange of filtering and, 
179-80 
Duality property: 
discrete Fourier series (DFS), 

544-^5, 547 
discrete Fourier transform 
(DFT), 567-68 

Eigenfunctions, 40 
Eigenvalues, 40-41 

See also Frequency response 
Elliptic approximation, 463-65, 

828-29 
Elliptic continuous-time filters, 

463-65, 828-29 
Energy density spectrum, 60 
Equiripple approximations, 

492-93 
Even function, 55 
Even sequence, 55 
Expander, 172 
Exponential multiplication, 

121-22 
Exponential sequences, 13-14, 

779-80 
left-sided, 99-100 
right-sided, 98 
sum of, 100-101 
Extraripple case, 493 



864 



Index 



Fast Fourier transform (FFT) 
algorithms, 2-3, 6, 576, 
629-92 
algorithms for more general 

values of N, 655 
coefficients, 654-55 
decimation-in-frequency 

algorithms, 646-52 
decimation-in-time FFT 
algorithms, 635-46 
indexing, 652-54 
Feedback, in IIR systems, 361-63 
FFT, See Fast Fourier transforms 
Filter design, 439-540 
bilinear transformation, 

450-65 
discrete-time filter, 

determining specifications 
for, 440-42 
discrete-time IIR filter design, 
from a continuous-time 
filters, 442-65 
FIR discrete-time filter design, 

510-11 
FIR equiripple approximation 
examples, 503-10 
bandpass filter, 507-10 
compensation for zero-order 

hold, 506-7 
lowpass filter, 503-6 
IIR discrete-time filter design, 

510-11 
impulse invariance, 443-49 
impulse invariance with a 
Butterworth filter, 446-49 
optimum approximations of 
FIR filters, 486-502 
alternation theorem, 489-91 
characteristics of optimum 

FIR filters, 501-2 
equiripple approximations, 

492 
extraripple case, 493 
optimal type II lowpass 

filters, 497-98 
optimal type I lowpass 

filters, 491-97 
Parks-McClellan algorithm, 
498-501, 510 
techniques, 439-540 
windowing, 465-78 
Bartlett window, 468-71 
Blackman window, 468fn, 

469 
Hamming window, 468-71 
Hanning window, 468-71 



incorporation of generalized 

linear phase, 469-73 
Kaiser window method, 

474-78 
linear-phase lowpass filter 

example, 472-73 
properties of commonly 
used windows, 468-69 
rectangular window, 468 
Filtering, interchange of down- 
sampling/upsampling and, 
179-80 
Filters: 
antialiasing, 186 
continuous-time IIR, 442-43 
finite impulse response (FIR), 

442 
frequency-selective, 439-540 
generalized linear-phase, 316 
ideal frequency-selective, 

43^4, 241^2 
linear-phase, 316 
optimal type II lowpass, 497-98 
optimal type I lowpass, 491-97 
sharp-cutoff antialiasing filters, 

186-87 
transversal, 367 
Finite-duration sequences, 105, 
571 
Fourier representation of, 

559-64 
See also Discrete Fourier 
transform (DFT) 
Finite impulse response (FIR) 

filters, 442 
Finite-length sequences, 103-4, 
117, 779 
periodic sequence, 783-87 
and power expansion, 117 
sufficiency theorems for, 
782-87 
Finite-precision numerical 
effects, 370-77 
numerical representations, 

371-74 
quantization in implementing 
systems, 374-77 
Finite register length, effects of, 

661-68 
FIR equiripple approximation 
examples, 503-10 
bandpass filter, 507-10 
compensation for zero-order 

hold, 506-7 
lowpass filter, 503-6 
FIR filters: 



optimum approximations of, 
486-502 
alternation theorem, 489-91 
characteristics of optimum 

FIR filters, 501-2 
equiripple approximations, 

492 
extraripple case, 493 
optimal type II lowpass 

filters, 497-98 
optimal type I lowpass 
filters, 491-97 
First backward difference, 88, 524 
First-order all-pass systems, 275 
FIR linear-phase systems: 
examples of, 300-305 
locations of zeros for, 306-8 
relation of minimum-phase 

systems to, 308-11 
type III linear-phase system, 

302 
type II linear-phase system, 302 
type I linear-phase system, 

300-302 
type IV linear-phase system, 
302-5 
FIR systems: 

basic network structures for, 
366-70 
cascade form, 367-68 
direct form, 367 
linear-phase FIR system 
structures, 368-70 
coefficient quantization in, 

384-86 
compensation of, 283-87 
Fixed-point realizations of IIR 
digital filters, zero-input 
limit cycles in, 413-18 
Floating-point realizations of 
discrete-time systems, 
412-13 
Flow graph, determination of 
system function from, 
352-53 
Flow graph 

reversal/transposition, 363 
Forward difference, 21, 31, 33 
Fourier transform, 63 
of complex exponential 

sequences, 54 
of a constant, 53 
linearity of, 59 
magnitude of, 49 
of a periodic impulse train, 552 
of periodic signals, 551-55 
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relationship between 
Fourier series coefficients 
and, 554-55 
phase of, 49 
sampling, 555-59 
Frequency: 
differentiation in, 60 
Doppler, 729-30 
Nyquist, 146-47 
sampling, 10, 140-41 
Frequency-domain 

representation: 
of discrete-time 

signals/systems, 40-48 
of sampling, 142-49 
Frequency response, 40-41 
determining impulse response 

from, 64 
of the ideal delay system, 41 
of the moving-average 
system, 44-45 
Frequency-response 

compensation, 282-87 
Frequency response for rational 
system functions, 253-70 
multiple poles or zeros, 265-70 
second-order FIR system, 

268 
second-order IIR system, 

265-67 
third-order IIR system, 
268-70 
single zero or pole, 258-265 
Frequency-selective filters, 
439-540 
See also Filter design 
Frequency shifting, 59 
Fricative sounds, 724 

Gain in dB, 254 

Gain of the system, 241 

Generalized linear phase, 295-97 

linear systems with, 291-311 
Generalized linear-phase filters, 

316 
Gibbs phenomenon, 468 
Goertzel algorithm, 629, 633-35 
Group delay: 

and attenuation, effects of, 
243^5 

defined, 243 

Hamming window, 468-71 
Hanning window, 468-71 
High-pass filters, 44 



Kaiser window method design 
of, 479-82 
Hilbert transformers, 791 
design of, 792-95 
Kaiser window design of, 

793-95 
See also Discrete Hilbert 
transforms 
Hilbert transform relations, 
775-76 
for complex sequences, 

789-801 
See also Discrete Hilbert 
transforms 
Homogeneous difference 

equation, 36 
Homogeneous solution, 36 

Ideal 90-degree phase shifter, 

790-91 
Ideal continuous-time 
bandlimited 
differentiator, 
discrete-time 

implementation of, 1 58-59 
Ideal continuous-time lowpass 
filtering, using 
discrete-time lowpass 
filter, 155-57 
Ideal continuous-to-discrete 

(C/D) converter, 141, 154, 
185 
Ideal delay system, 17, 31 

frequency response of, 41 
Ideal discrete-to-continuous 

(D/C) converter, 152-153, 
185 
Ideal frequency-selective filters, 

43^44, 241^12 
Ideal highpass filters: 
frequency response of, 44, 242 
impulse response of, 242 
Ideal lowpass filters, 43 
frequency response of, 43, 241 
impulse response of, 242 
with linear phase, 242-43 
Ideal reconstruction filter, 150-51 
Ideal signal reconstruction 

system, 150-51 
IIR systems: 
basic structures for, 354-63 
cascade form, 356-59 
direct forms, 354-56 
parallel form, 359-61 
coefficient quantization in, 
377-82 



feedback in, 361-63 
Image processing, application of 
multidimensional digital 
processing to, 4 
Impulse, 11 

Impulse invariance, 160-63, 517 
applied to continuous-time 
systems with rational 
system functions, 162-63 
with a Butterworth filter, 

446-49 
discrete-time lowpass filter 

obtained by, 162 
filter design by, 443-49 
Impulse response: 
determining from frequency 

response, 64 
for a difference equation, 
determining, 64-65 
Impulse responses, 31-32 
Impulse train modulation, 142 
Infinite-duration impulse 

response (IIR) systems, 32 
Infinite impulse response (IIR) 

filters, 442 
Infinite sum, expressing closed 

form, 97-98 
Initial-rest conditions, 38 
Initial-value theorem, 126 
Innermost nonzero pole, 105 
Inspection method for inverse 

z-transform, 111-12 
Instability, 21-22 
testing for, 22 
Interpolation, 173 
frequency-domain illustration 

of, 174 
linear, 175-76 
by filtering, 175 
impulse response for, 175 
Interpolator, 173 
Inverse by partial fractions, 

115-16 
Inverse DFT algorithm, 676 
Inverse Fourier transform, 48, 63 
Inverse of non-rational 

z-transform, 122-23 
Inverse systems: 
defined, 33-34 
system functions for, 248-50 
Inverse transform, by a power 

series expansion, 117 
Inverse z-transform, 111-18 
inspection method, 111-12 
inverse by partial fractions, 
115-16 
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partial fraction expansion, 

112-16 
second-order z-transform, 

113-14 

Kaiser window, 474-82 
DFT analysis of sinusoidal 
signals using, 708-10 
Kaiser window design, of Hilbert 

transformers, 793-95 
Kaiser window method, 474-78 
examples of FIR filter design 
by, 478-85 
discrete-time differentiators, 

482-85 
highpass filter, 479-82 
and lowpass filter design, 

476-78 
relationship to other windows, 
478 

Leakage, 701 

Left-sided exponential sequence, 

99-100 
Left-sided sequence, 105 

power series expansion for, 118 
L'Hopital's rule, 151 
Limit cycles: 
avoiding, 417-18 
due to overflow, 416-17 
due to round-off, 414-16 
due to truncation, 414-16 
in first-order system, 414-16 
Linear chirp signal, 

time-dependent Fourier 
transform of, 715-17 
Linear constant-coefficient 
difference equations, 
34-^0 
block diagram representation 

of, 341^48 
impulse response for rational 
system functions, 250-53 
first-order IIR system, 

251-52 
simple FIR system, 252-53 
inverse systems, 248-50 
for first-order system, 249-50 
with zero in the ROC, 250 
region of convergence (ROC), 

determining, 247-48 
second-order system, 246-47 
signal flow graph 

representation of, 348-53 
stability and causality, 247-48 



system functions for systems 
characterized by, 245-53 
Linear convolution, 576-88 
using discrete Fourier 

transform (DFT), 576-88 
Linearity: 
and auxiliary conditions, 39 
of Fourier transform, 59 
Linearity property: 
discrete Fourier series (DFS), 

546 
discrete Fourier transform 

(DFT), 564 
z-transform, 119 
Linear noise models, 391-412 
cascade form IIR systems, 

403^110 
direct form FIR systems, 

410-12 
direct form IIR systems, 

391-403 
parallel form IIR sytmes, 410 
Linear phase, 291-311 
causal generalized linear-phase 
systems, 297-311 
type I FIR linear-phase 

systems, 298 
type II FIR linear-phase 

systems, 298 
type III FIR linear-phase 

systems, 298 
type IV FIR linear-phase 
systems, 298-99 
decomposition of a 

linear-phase system, 
308-11 
FIR linear-phase systems: 
examples of, 300-305 
locations of zeros for, 306-8 
relation of minimum-phase 

systems to, 308-1 1 
type III linear-phase system, 

302 
type II linear-phase system, 

302 
type I linear-phase system, 

300-302 
type IV linear-phase system, 
302-5 
generalized linear phase, 

295-97 
ideal lowpass filter with, 

293-95 
systems with, 292-95 
Linear-phase filters, 316 



Linear-phase FIR system 
structures, 368-70 
Linear predictive coding (LPC), 4 
Linear quantizers, 191 
Linear system, 78-79 
Linear systems, 18 

accumulator system, 19 
nonlinear system, 19 
Linear time-invariant 

discrete-time systems, 
22-28, 154-60 
all-pass systems, 274-79 
causal all-pass systems, 

274-78 
defined, 274 
first- and second-order 
all-pass systems, 275 
uses of, 278 
convolution sum, 23-28 
analytic evaluation of, 26-28 
computation of, 25-26 
defined, 23 
direct form II implementation 

of, 347^18 
direct form I implementation 

of, 346-47 
eigenfunctions for, 40-45 
frequency response of, 241-45 
ideal frequency-selective 

filter, 241^12 
phase distortion and delay, 
242^*5 
frequency response for rational 
system functions, 253-70 
multiple poles and zeros, 

265-70 
single zero or pole, 258-65 
generalized linear phase, linear 

systems with, 291-311 
ideal continuous-time 
bandlimited 
differentiator, 
discrete-time 

implementation of, 158-59 
ideal continuous-time lowpass 
filtering, using 
discrete-time lowpass 
filter, 155-57 
minimum-phase systems, 
280-91 
frequency-response 

compensation, 282-87 
minimum-phase and all-pass 

decomposition, 280-82 
properties of, 287-91 
properties of, 28-34 
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cascade connection, 29 
constraints of linearity/time 

invariance, 30-31 
finite-duration impulse 
response (FIR) systems, 
32-33 
impulse responses, 31-32 
infinite-duration impulse 

response (IIR) systems, 32 
parallel connection, 30 
relationship between 

magnitude and phase, 
270-74 
transform analysis of, 240-339 
Log magnitude, 254 
Long division, power series 
expansion by, 118 

Magnitude: 
Fourier transform, 49 
relationships between phase 

and, 788-89 
Magnitude distortions, 241 
Magnitude response, 241 
Magnitude spectrum, 49 
Magnitude-squared function, 

254, 258, 457 
Mantissa, 412 
Matlab, 3 
Maximum entropy methods 

(MEM spectral analysis), 

4 
Maximum-phase sequence, 335 
Memoryless systems, 18 
MEM spectral analysis, 4 
Microelectronics, 6-7 
Microprocessors: 
and discrete-time signals, 7 
rapid evolution of, 2 
Minimax criteriod, 489 
Minimum energy-delay property, 

minimum-phase systems, 

288-91 
Minimum group-delay property, 

minimum-phase systems, 

288 
Minimum phase-lag property, 

minimum-phase systems, 

287-88 
Minimum-phase systems, 250, 

280-91 
frequency-response 

compensation, 282-87 
minimum-phase and all-pass 

decomposition, 280-82 
properties of, 287-91 



minimum energy-delay 

property, 288-91 
minimum group-delay 

property, 288 
minimum phase-lag 
property, 287-88 
relation of FIR linear-phase 
systems to, 308-11 
Modified periodogram, 732 
Modulation theorem, 61-62 
Moving average, 17-18, 31 
Moving-average (MA) linear 

random process, 771 
Moving-average system: 
difference equation 

representation of, 35-36 
with noninteger delay, 165-67 
Multidimensional signal 

processing, 3^4 
Multiplication by an exponential 

sequence, 121-22 
Multirate signal processing, 
179-84 
interchange of filtering and 
downsam- 
pling/upsampling, 
179-80 
polyphase decompositions, 

180-82 
polyphase implementation of 
decimation filters, 182-83 
polyphase implementation of 
interpolation filters, 
183-84 
Multistage noise shaping 
(MASH), 210 

Narrowband time-dependent 

Fourier analysis, 725 
Nonanticipative system, 21 
Noncausal window, 716 
Noncomputable network, 363 
Noninteger delay, 164-65 
moving-average system with, 
165-67 
Nonlinear system, 19 
Non-rational z-transform, 

inverse of, 122-23 
Nonstationary signals: 
time-dependent Fourier 
analysis of, 723-30 
radar signals, 728-30 
speech signals, 720-28 
N -point circular convolution, 571 
Nyquist frequency, 146-47 
Nyquist rate, 146-47, 153 



Nyquist sampling theorem, 146 

Odd function, 55 

Odd sequence, 55 

Offset binary coding scheme, 191 

One's complement, 371 

One-sided z-transform, 95 

Optimal type II lowpass filters, 

497-98 
Optimal type I lowpass filters, 

491-97 
Optimum approximations of FIR 
filters, 486-502 
alternation theorem, 489-91 

and polynomials, 290-91 
characteristics of optimum FIR 

filters, 501-2 
equiripple approximations, 492 
extraripple case, 493 
optimal type II lowpass filters, 

497-98 
optimal type I lowpass filters, 

491-97 
Parks-McClellan algorithm, 
498-501 
Outermost finite pole, 105 
Overflow oscillations, in 

second-order system, 
416-17 
Overlap-add method, 586-87, 680 
Overlap-save method, 587, 680 
Oversampled A/D conversion: 
with direct quantization, 201-5 
with noise shaping, 206-10 
Oversampled D/A conversion, 
and noise shaping, 210-13 

Parallel connection, 30 
Parallel form structures: 
coefficient quantization effects, 

382 
IIR systems, 359-61 
Roundoff noise effects, 410 
Parks-McClellan algorithm, 487, 

498-501, 506, 510 
Parseval's relation: 

discrete Fourier transform, 621 
Fourier transform, 60 
Parseval's theorem, 60, 400 
Partial fractions, inverse by, 

115-16 
Periodic 

conjugate-antisymmetric 
components, 570 
Periodic conjugate-symmetric 
components, 570 
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Periodic convolution: 
denned, 548 

discrete Fourier series (DFS), 
548-51 
Periodic discrete-time sinusoids, 

15 
Periodic impulse train, 143 
Periodic sampling, 140-42 
Periodic sequences, 

representation of, 542-46 
Periodic signals, Fourier 

transform of, 551-55 
Periodogram, 730-42 
averaging of, 737-39 
denned, 732 

explicit computation of, 732 
modified, 732 
periodogram analysis, 731, 
739-42 
example of, 739-42 
power spectrum, 731-32, 734 
properties of, 733-37 
Periodogram analysis, 731, 

739^12 
Phase: 
Fourier transform, 49 
relationships between 

magnitude and, 788-89 
Phase distortion and delay, 

242-45 
Phase response, 241 
Phase shift, 241 
Phase spectrum, 49 
Plosive sounds, 724 
Poisson's formulas, 776 
Poles of X(z), 298 
Polyphase decompositions, 

180-82 
Polyphase implementation: 
of decimation filters, 182-83 
of interpolation filters, 183-84 
Power density spectrum, 68 

of quantization noise, 207-9 
Power series expansion, 116-18 
by long division, 118 
finite-length sequence, 117 
inverse transform by, 117 
for a left-sided sequence, 118 
Power spectrum, 731-32, 734 
estimation: 
computing using DFT, 

746-48 
example based on estimation 
of autocorrelation 
sequence, 748-54 



Prefiltering, to avoid aliasing, 

185-87 
Product of two sequences, 11 

Quantization errors, 372 

analysis of, 193-97 

for sinusoidal signal, 194-95 
Quantization levels, 191-94 

coding of, 191 
Quantization noise: 

example of, 195 

power density spectrum of, 
207-9 

Radar signals: 
clutter, 729 

Doppler frequency, 729-30 
time-dependent Fourier 
analysis of, 728-30 
Random process, 65 
Random signals, 65-70, 811-23 
spectrum analysis of, 730-54 
Rational system functions: 
frequency response for, 250-70 
multiple poles and zeros, 

265-70 
single zero or pole, 258-65 
impulse response for, 250-53 
first-order IIR system, 

251-52 
simple FIR system, 252-53 
Reconstruction of sinusoidal 
signal, 147 
undersampled, aliasing in, 
148-49 
Rectangular window, 471 
Recursive computation of 
difference equations, 
37-38 
Recursive representation, 35 
Region of convergence (ROC), 
96, 105-11 
and causality, 110-11 
properties of, for ^-transform, 

105-11 
and stability, 110-11 
Region of convergence (ROC), 

96-97 
Right-sided exponential 

sequence, 98 
Right-sided sequence, 105, 108 
Rotations, 684 

Round-off, limit cycles due to, 
414-16 

Sample-and-hold circuits, 188-89 



Sampled-data Delta-Sigma 

modulator, 206 
Sampling: 
bandpass, 799-801 
downsampling, 168-72, 179-80 
Fourier transform, 555-59 
frequency-domain 

representation of, 142-49 
periodic, 140-42 
spectral, 703-14 
in time/frequency, 718-22 
upsampling, 172-76, 179-80 
Sampling the Fourier transform, 

555-59 
Sampling frequency, 10, 140-41 
Sampling period, 10, 140-42 
Sampling rate change by 

noninteger factor, 176-78 
Sampling rate compressor, 

167-68 
Sampling rate expander, 172 
Sampling rate increase by integer 

factor, 172-76 
Sampling rate reduction by 

integer factor, 167-72 
Second-order all-pass systems, 

275 
Second-order ^-transform, 

113-14 
Sequence operations, 11-16 
Sequences: 

autocorrelation, of h[n], 67-68 
autocovariance, 65-66 
causal, 31, 129, 777-82 
circular shift of, 564-67 
complex, 789-801 
complex exponential, 14 
conjugate-antisymmetric, 

55-56 
conjugate-symmetric, 55-56 
delayed impulse sequence, 

572-73 
deterministic autocorrelation, 

67-68 
even, 55 

exponential, 13-14, 779-80 
finite-duration, 105, 571 
finite-length, 103^1, 779 
left-sided, 99-100, 105, 118 
maximum-phase, 335 
odd, 55 

periodic, 542-46 
representation of, by Fourier 

transforms, 48-54 
right-sided, 98, 105, 108 
shifted exponential, 120-21 
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sinusoidal, 13 
two-sided, 108-10 
unit sample, 11 
unit step, 11-13 
Sharp-cutoff antialiasing filters, 

186-87 
Shifted exponential sequence, 

120-21 
Shift of sequences, 59 
circular, 564-67 
periodic, 546-47 
Shifting: 
frequency, 59 
time, 59, 120-21 
Shift of a sequence, discrete 
Fourier series (DFS), 
546-47 
Short-time Fourier transform, 
See Time-dependent 
Fourier transform 
Time-dependent Fourier 
transform, 714-22 
Signal: 
defined, 8 

independent variable in 
mathematical 
representation of, 8 
Signal expression processing, 3 
Signal interpretation, 2-3 
Signal modeling, 4 
Signal processing, defined, 1-2 
Signal processing 

microprocessors, 
processing capability of, 1 
Signal-processing systems, 
classification of, 8-9 
Sign bit, 371 

Sign and magnitude, 371 
Sink nodes, 349 
Sinusoidal response, of linear 
time-invariant systems, 
42-43 
Sinusoidal sequences, 13 
Sinusoidal signals, DFT analysis 
of, 697-714 
oversampling/linear 
interpolation for 
frequency estimation, 
713-14 
spectral sampling, 703-14 
with 32-point Kaiser window 

and zero-padding, 711-12 
using a Kaiser window, 708-10 
windowing, 698-703 
Source nodes, 349 
Spectral analysis, 4, 6 



Spectral sampling: 
effect of, 703-14 

illustration of, 703-6 
with frequencies matching 
DFT frequencies, 706-8 
Spectrum: 
amplitude, 49 
energy density, 60 
magnitude, 49 
phase, 49 

power, 731-32, 734 
power density, 68, 207-9 
Speech signals: 

time-dependent Fourier 
analysis of, 720-28 
narrowband spectrogram, 

728 
wideband spectrogram, 
725-28 
Split-radix FFT (SRFFT), 683 
Square-summability, for the ideal 

lowpass filter, 52-53 
SRFFT, 683 

Stability, 21-22, 30-31, 247^8 
and region of convergence, 

110-11 
testing for, 22 
Stationary, use of term, 66 
Stationary random signals, 

Fourier analysis of, 730-42 
Steady-state response, 46 
Stochastic signals, See Random 

signals 
Structures for discrete-time 
systems, 340-418 
block diagram representation 
of linear 

constant-coefficient 
difference equations, 
341^8 
cascade form, See Cascade 

form structures 
direct form, See Direct form 

structures 
finite precision numerical 

effects, See Quantization 
FIR systems, 366-70 
IIR systems, 354-63 
parallel form, See Parallel form 

structures 
signal flow graph 

representation of linear 
constant-coefficient 
difference equations, 
348-53 
transposed forms, 363-66 



Suddenly-applied complex 

exponential inputs, 46-48 
Suddenly-applied exponential, 
absolute summability for, 
51-52 
Sufficiency theorems for 

finite-length sequences, 
782-88 
Summability: 
absolute, 51, 108 
for suddenly-applied 
exponential, 51-52 
square-, 52-53 
Superposition, principal of, 22-24 
Surface acoustic wave (SAW), 2 
Switched-capacitor technologies, 

2 
Symmetry properties: 
discrete Fourier series (DFS), 

547 
discrete Fourier transform, 

568-70 
discrete- time Fourier 

transform (DTFT), 55-58 
Synthesis formula, 48 
System function, 241 
Systems, 374-77 

Tapped delay line structure, 367 
Telecommunications, and 
discrete-time signal 
processing, 7 
Time-dependent Fourier analysis 
of nonstationary signals, 
723-30 
radar signals, 728-30 
speech signals, 720-28 
Time-dependent Fourier 

transform, 693, 714-22 
block convolution using, 

722-23 
defined, 714 

effect of the window in, 717-18 
of a linear chirp signal, 715-17 
sampling in time/frequency, 
718-22 
Time invariance, and auxiliary 

conditions, 39 
Time-invariant systems, 20-21, 77 
accumulator as, 20 
compressor system, 20-21 
Time-reversal property, 

z -transform, 123-24 
Time reversal theorem, 60 
Time -shifting property: 
discrete Fourier series, 546 
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discrete Fourier transform, 

564-67 
Fourier transform, 59 
z-transform, 120-21 
shifted exponential 

sequence, 120-21 
Time-shifting theorem, 59 
Transient response, 46-47 
Transposed forms, 363-66 
for a basic second-order 

section, 364-65 
for first-order system with no 

zeros, 363-64 
Transversal filter structure, 367 
Trapezoidal approximation, 525 
Truncation, limit cycles due to, 

414-16 "Twicing," 528 
Two-dimensional signal 

processing techniques, 3-4 
Two's complement, 371 
Two-sided exponential sequence, 

102 
Two-sided sequences, 108-10 
Type I FIR linear-phase systems, 

298 
Type II FIR linear-phase systems, 

298 
Type III FIR linear-phase 

systems, 298 
Type IV FIR linear-phase 

systems, 298-99 

Undersampled sinusoidal signal, 
reconstruction of, 148-49 

Uniform convergence, of 
z-transform, 97 

Unilateral z-transform, 95 

Unit circle, 95-96 

Unit impulse function, 142^3 
sifting property of, 143 

Unit sample sequence, 11 

Unit step sequence, 11-13 

Unweighted approximation 
error, 503 

Upsampling, 172-76 



interchange of filtering and, 
179-80 

Video coding, 3 
Vocal tract, 724 
Vocoder simulations, 5 
Voiced sounds, 724 
Von Hann, Julius, 468fn 

Warping, and bilinear 

transformation, 453-54 
"Whitening" procedure, 
333 
White noise, 69 
Wideband spectrogram, 725 
Windowing, 465-78, 693 
Bartlett window, 468-71 
Blackman window, 468fn, 469 
effect of, 698-703 
on Fourier analysis of 

sinusoidal signals, 698-701 
Hamming window, 468-71 
Hanning window, 468-71 
incorporation of generalized 

linear phase, 469-73 
Kaiser window, 474-78 
linear-phase lowpass filter 

example, 472-73 
rectangular window, 468 
Windowing theorem, 61-62 
Winograd Fourier transform 
algorithm (WFTA), 
655-56 

Zero-input limit cycles, defined, 

376, 413 
Zero-order hold, compensation 

for, 506-7 
Zero padding, 583 
Zeros of X(z), 98 
z-plane, 96 
z-transform, 94-139 

common pairs, 104 

defined, 95 



evaluating a convolution using, 

125 
finite-duration sequence, 105 
finite-length sequence, 103^4 
infinite sum, expressing closed 

form, 97-98 
inverse z-transform, 111-18 
inspection method, 111-12 
partial fraction expansion, 
112-16 
left-sided sequence, 99-100, 

105 
power series expansion, 116-18 
by long division, 118 
finite-length sequence, 117 
inverse transform by, 1 17 
for a left-sided sequence, 118 
region of convergence 

properties for, 105-11 
region of convergence (ROC), 

96-97 
right-sided sequence, 98, 105 
sum of two exponential 
sequences, 100-101 
transform properties, 119-26 
conjugation property, 123 
convolution property, 

124-26 
differentiation property, 

122-23 
exponential multiplication, 

121-22 
initial-value theorem, 126 
inverse of non-rational 
z-transform, 122-23 
linearity property, 119 
time-reversal property, 

123-24 
time-shifting property, 
120-21 
two-sided sequence, 102, 105 
uniform convergence of, 97 
unit circle, 95-96 
z-transform operator Z, 95 
z-transform pairs, 104 



A 

Random signals 



In this appendix, we collect and summarize a number of results and establish the notation 
relating to the representation of stochastic signals. We make no attempt here to provide 
a detailed discussion of the difficult and subtle mathematical issues of the theory of 
random processes. Although our approach is not rigorous, we have summarized the 
important results and the mathematical assumptions implicit in their derivation. 



A.1 DISCRETE-TIME RANDOM PROCESSES 

The fundamental concept in the mathematical representation of stochastic signals is 
that of a random process. In our discussion of random processes as models for discrete- 
time signals, we assume that the reader is familiar with basic concepts of the theory of 
probability, such as random variables, probability distributions, and averages. 

In utilizing the random-process model in practical signal-processing applications, 
we consider a particular sequence to be one of an ensemble of sample sequences. Given 
a discrete-time signal, the structure, i.e., the underlying probability law, of the corre- 
sponding random process is generally not known and must somehow be inferred. It 
may be possible to make reasonable assumptions about the structure of the process, or 
it may be possible to estimate the properties of a random-process representation from 
a finite segment of a typical sample sequence. 

Formally, a random process is an indexed family of random variables {x„} charac- 
terized by a set of probability distribution functions that, in general, may be a function 
of the index n. In using the concept of a random process as a model for discrete-time 
signals, the index n is associated with the time index. In other words, each sample value 
x[n] of a random signal is assumed to have resulted from a mechanism that is governed 
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by a probability law. An individual random variable \ n is described by the probability 
distribution function 

Px„(xn, n) = Probability [x„ < x n ], (A.l) 

where x„ denotes the random variable and x n is a particular value of x,,. 1 If x„ takes 
on a continuous range of values, it is equivalently specified by the probability density 
function 

f v dP Xn (x n ,n) 

Px n (*n,n) = , (A.2) 

dx n 

or 

p Xn (x,n)dx. (A3) 

■00 

The interdependence of two random variables x„ and x m of a random process is 
described by the joint probability distribution function 

Px„,x m (xn, «, x m , m) = Probability [x„ < x n and x m < x m ] (A.4) 

and by the joint probability density 

, v d 2 Px n ,x m (xn, n, x m , m) 
Px„,x m (xn, n, x m , m) = ^— . (A.5) 

Two random variables are statistically independent if knowledge of the value of 
one does not affect the probability density of the other. If all the random variables of a 
collection of random variables, {x„}, are statistically independent, then 

Px n ,x m (x n , n, x m , m) = P Xn (x n , n) • P Xm (x m , m) m^n. (A.6) 

A complete characterization of a random process requires the specification of all 
possible joint probability distributions. As we have indicated, these probability distribu- 
tions may be a function of the time indices m and n. In the case where all the probability 
distributions are independent of a shift of time origin, the random process is said to be 
stationary. For example, the second-order distribution of a stationary process satisfies 

Px„+k,x m +k(xn+k, n + k, x m+k , m + k)= P Xn x m (x n , n, x m , m) for all fc. (A.7) 

In many of the applications of discrete-time signal processing, random processes 
serve as models for signals in the sense that a particular signal can be considered a sample 
sequence of a random process. Although the details of such signals are unpredictable — 
making a deterministic approach to signal representation inappropriate — certain av- 
erage properties of the ensemble can be determined, given the probability law of the 
process. These average properties often serve as a useful, although incomplete, charac- 
terization of such signals. 

^n this appendix, boldface type is used to denote the random variables and regular type denotes 
dummy variables of probability functions. 
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A.2 AVERAGES 

It is often useful to characterize a random variable by averages such as the mean and 
variance. Since a random process is an indexed set of random variables, we may likewise 
characterize the process by statistical averages of the random variables making up the 
random process. Such averages are called ensemble averages. We begin the discussion 
of averages with some definitions. 

A.2.1 Definitions 

The average, or mean, of a random process is defined as 

/oo 
xp^(x,n)dx y (A.8) 

■oo 

where £ denotes an operator called mathematical expectation. In general, the mean 
(expected value) may depend on n. In addition, if g(-) is a single-valued function, then 
g(\ n ) is a random variable, and the set of random variables {g(x„)} defines a new random 
process. To compute averages of this new process, we can derive probability distributions 
of the new random variables, or it can be shown that 

SlgM) = f X g(x)[^(x, n)dx. (A.9) 

J — CO 

If the random variables are discrete — i.e., if they have quantized values — the integrals 
become summations over all possible values of the random variable. In that case £{g(x)} 
has the form 

£{g(*n)) = X>«i*,(*. «)■ (A.10) 

x 

In cases where we are interested in the relationship between two (or more) random 
processes, we must be concerned with two sets of random variables {x n } and {y m }. For 
example, the expected value of a function of two random variables is denned as 

/CO TOO 
/ g(x,y)p SHtJm (x f n t y t m)dxdy 1 (A.ll) 

■CO ./-co 

where p*„,y m (x m , n, y m , m) is the joint probability density of the random variables x n and 

The mathematical expectation operator is a linear operator; that is, it can be shown 
that 

1. £{x n + ym) = £{xnl + £{yml; i.e., the average of a sum is the sum of the averages. 

2. £[ax n ) = a£[x n ); i.e., the average of a constant times x n is equal to the constant 
times the average of x n . 

In general, the average of a product of two random variables is not equal to the 
product of the averages. When this property holds, however, the two random variables 
are said to be linearly independent or uncorrelated. That is, x n and y m are linearly inde- 
pendent or uncorrelated if 

^y,*} = £{x m ) . £{y m ). (All) 
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It is easy to see from Eqs. (A.ll) and (A.12) that a sufficient condition for linear inde- 
pendence is 

Px n ,y m (xn, n, y m , m) = p^{x n , n) • p ym (y m , m). (A.13) 

However, it can be shown that Eq. (A.13) is a stronger statement of independence than 
Eq. (A.12). As previously stated, random variables satisfying Eq. (A.13) are said to 
be statistically independent. If Eq. (A.13) holds for all values of n and m, the random 
processes {x„} and {y w } are said to be statistically independent. Statistically independent 
random processes are also linearly independent; but the converse is not true: Linear 
independence does not imply statistical independence. 

It can be seen from Eqs. (A.9)-(A.ll) that averages generally are functions of the 
time index. In the case of stationary processes, this is not true: For stationary processes, 
the mean is the same for all the random variables that constitute the process; i.e., the 
mean of a stationary process is a constant, which we denote simply m x . 

In addition to the mean of a random process, as defined in Eq. (A.8), a number 
of other averages are particularly important within the context of signal processing. 
These are defined next. For notational convenience, we assume that the probability 
distributions are continuous. Corresponding definitions for discrete random processes 
can be obtained by applying Eq. (A. 10). 

The mean-square value of x n is the average of \x n \ 2 ; i.e., 

/oo 
|*| 2 Px„(x,/i)djt. (A.14) 

■oo 

The mean-square value is sometimes referred to as the average power. 
The variance of x n is the mean-square value of [x„ — m Xn \\ i.e., 

var[x„] = £{|(x„ - m Xn )\ 2 } = a 2 . (A.15) 

Since the average of a sum is the sum of the averages, it can easily be shown that 
Eq. (A.15) can be written as 

var[x n ] = E{|x n | 2 }-|m JC J 2 . (A.16) 

In general, the mean-square value and the variance are functions of time; however, they 
are constant for stationary processes. 

The mean, mean square, and variance are simple averages that provide only a small 
amount of information about a process. A more useful average is the autocorrelation 
sequence, which is defined as 

4>xx[n, m] = £{x n x* m ) 

/oo roo (A.17) 

/ x n x* m p XntXm (x n , n, x m , m)dx n dx m , 
■oo J —oo 

where * denotes complex conjugation. The autocovariance sequence of a random pro- 
cess is defined as 

y xx [n, m] = S{(x n - m Xn ){x m - m x J*}, (A.18) 

which can be written as 

Yxx[n, m] = 4> xx [n, m] - m Xn m Xm . (A.19) 
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Note that, in general, both the autocorrelation and autocovariance are two-dimensional 
sequences, i.e., functions of two variables. 

The autocorrelation sequence is a measure of the dependence between values of 
the random processes at different times. In this sense, it partially describes the time 
variation of a random signal. A measure of the dependence between two different 
random signals is obtained from the cross-correlation sequence. If {x„} and {y m } are two 
random processes, their cross-correlation is 

</> xx [n,m] = €{\ n y* m } 

(A.20) 



/oo /»oo 
/ xy*p*n.jn,(x* n > y, m ) dx d y> 
-OO J —oo 



where Px„,y m (*, n, v, m) is the joint probability density of \ n and y TO , The cross-covariance 
function is defined as 

Yxx[n, m] = £{(\ n - m Xn ){y m - m y J*} 

= 4> xy [n, m] - m Xn m* ym . 

As we have pointed out, the statistical properties of a random process generally 
vary with time. However, a stationary random process is characterized by an equilibrium 
condition in which the statistical properties are invariant to a shift of time origin. This 
means that the first-order probability distribution is independent of time. Similarly, all 
the joint probability functions are also invariant to a shift of time origin; Le., the second- 
order joint probability distributions depend only on the time difference (m — n). First- 
order averages such as the mean and variance are independent of time; second-order 
averages, such as the autocorrelation <p xx [n, m], are dependent on the time difference 
(m — n). Thus, for a stationary process, we can write 

m x = £{x„}, (A.22) 

a 2 = S{\(x n -m x )\ 2 }, (A.23) 

both independent of n, and now if we denote the time difference by m, we have 

<Pxx[n + m, n] = <t> xx [m] = S{x n+m x* n }. (A.24) 

That is, the autocorrelation sequence of a stationary random process is a one-dimensional 
sequence, a function of the time difference m. 

In many instances, we encounter random processes that are not stationary in the 
strict sense — i.e., their probability distributions are not time invariant — but Eqs. (A.22)- 
(A.24) still hold. Such random processes are said to be wide-sense stationary. 

A. 2. 2 Time Averages 

In a signal-processing context, the notion of an ensemble of signals is a convenient 
mathematical concept that allows us to use the theory of probability to represent the 
signals. However, in a practical situation, we always have available at most a finite 
number of finite-length sequences rather than an infinite ensemble of sequences. For 
example, we might wish to infer the probability law or certain averages of the random- 
process representation from measurements on a single member of the ensemble. When 
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the probability distributions are independent of time, it seems intuitively that the am- 
plitude distribution (histogram) of a long segment of an individual sequence of samples 
should be approximately equal to the single probability density that describes each of 
the random variables of the random-process model. Similarly, the arithmetic average of 
a large number of samples of a single sequence should be very close to the mean of the 
process. To formalize these intuitive notions, we define the time average of a random 
process as 

1 L 
<x„) = lim — — Y, x «- ( A - 25 ) 

n—~L 

Similarly, the time autocorrelation sequence is defined as 

1 L 
{x n + m x* n ) = lim J2 Xn+mx;. (A.26) 

n=—L 

It can be shown that the preceding limits exist if {x„} is a stationary process with finite 
mean. As defined in Eqs. (A.25) and (A.26), these time averages are functions of an 
infinite set of random variables and thus are properly viewed as random variables 
themselves. However, under the condition known as ergodicity, the time averages in 
Eqs. (A.25) and (A.26) are equal to constants in the sense that the time averages of 
almost all possible sample sequences are equal to the same constant. Furthermore, 
they are equal to the corresponding ensemble average. 2 That is, for any single sample 
sequence [x[n]} for — oo < n < oo, 

1 L 
(x[n]) = lim — — T x[n] = €{x n } = m x (A.27) 

^-►oo LL-\- 1 *— '. 



■+-— L 



and 



1 
(x[n + m]x*[n]) = lim — — V x[n + m]x*[n] = £{x„+ m x;;} = 4> xx [m). (A.28) 

L-»-oo ZL+ 1 j£ — ' 
n——L 

The time-average operator {■) has the same properties as the ensemble-average operator 
£{•}. Thus, we generally do not distinguish between the random variable x„ and its value 
in a sample sequence, x[n]. For example, the expression £{*[«]} should be interpreted 
as £{x„} = (x[n\). In general, a random process for which time averages equal ensemble 
averages is called an ergodic process. 

In practice, it is common to assume that a given sequence is a sample sequence of 
an ergodic random process so that averages can be computed from a single sequence. 
Of course, we generally cannot compute with the limits in Eqs. (A.27) and (A.28), but 
instead the quantities 

1 L_1 
jfc, = T X>M. (A-29) 

n=0 



1 L_1 

o 2 x = jY\x[n]-m x \\ (A.30) 



2 A more precise statement is that the random variables {x„) and {x„ +m x*) have means equal to m x 
and <kt;r[m], respectively, and their variances are zero. 
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and 

1 L ~ l 
{x[n + m]x*[n\) L = - ^x\n +m]x*[n] (A.31) 

or similar quantities are often computed as estimates of the mean, variance, and au- 
tocorrelation. m x and o 2 are referred to as the sample mean and sample variance, 
respectively. The estimation of averages of a random process from a finite segment of 
data is a problem of statistics, which we touched on briefly in Chapter 10. 

A.3 PROPERTIES OF CORRELATION AND COVARIANCE 
SEQUENCES 

Several useful properties of correlation and covariance functions follow in a simple way 
from the definitions. These properties are given in this section. 

Consider two real stationary random processes {x„} and {y„} with autocorrelation, 
autocovariance, cross-correlation, and cross-co variance being given, respectively, by 

4>xx N = £ {Xn+mK } , ( A.32) 

Yxx[m] = £{(x„ +m - m x )(\ n -m x )*}, (A.33) 

4>xy[m] = £{Xn+mf n )' (A.34) 

y xy [m] = £{(x n+ m - m x )(y n - m y )*}, (A.35) 

where m x and m y are the means of the two processes. The following properties are easily 
derived by simple manipulations of the definitions: 

Property 1 

Yxx[m\ = 4> xx [m] - \m x \ 2 , (A.36a) 

Yx y [m] = 4>xy[m] - m x m* y . (A.36b) 

These results follow directly from Eqs. (A.19) and (A.21), and they indicate that the 
correlation and covariance sequences are identical for zero-mean processes. 

Property 2 

tp xx [0] = E[\\ n \ 2 ] = Mean-square value, (A.37a) 

Yxx [0] = a] = Variance. (A.37b) 



Property 3 



4>xx[-m] = 4>* x [m], (A.38a) 

Yxxl-m] = >£[m], (A.38b) 

4> xy [-m] = 4>* yx [ml (A.38c) 

Yxyl-m] = Y ; x [™l (A.38d) 



In particular, 
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Property 4 

\<Pxy[m]\ 2 < <MO]<M°L ( A - 39a ) 

\Y xy [m]\ 2 < Yxx[0]Yyy[Ol (A39b) 

\<t>xx[m]\ < <Pxx[0], (A.40a) 

\Yxx[m]\ < Yxx[0]- (A.40b) 

Property 5. If y„ = x,,^, then 

<t> yy [m\ =4> xx [m], (A.41a) 

/yyN = K«M. (A.41b) 

Property 6. For many random processes, the random variables become uncorre- 
cted as they become more separated in time. If this is true, 

lim y xx [m]=0, (A.42a) 

m-*-oo 

lim 4> xx [m] = \m x \ 2 , (A.42b) 

lim Y X y[m] = 0, (A.42c) 

lim </»jcy[m] = m^m* (A.42d) 

The essence of these results is that the correlation and covariance are finite-energy 
sequences that tend to die out for large values of m. Thus, it is often possible to represent 
these sequences in terms of their Fourier transforms or z-transforms. 

A.4 FOURIER TRANSFORM REPRESENTATION 
OF RANDOM SIGNALS 

Although the Fourier transform of a random signal does not exist, the autocovariance 
and autocorrelation sequences of such a signal are aperiodic sequences for which the 
transform does exist. The spectral representation of the correlation functions plays 
an important role in describing the input-output relations for a linear time-invariant 
system when the input is a stochastic signal. Therefore, it is of interest to consider the 
properties of correlation and covariance sequences and their corresponding Fourier 
and z-transforms. 

Let us define ® xx (e ja} ), T xx {e jco ), $> xy (e j< °), and T xy (e i<0 ) as the Fourier transforms 
of <p xx [m], Yxx[m], 4>xy[*n]> an d Yxy[*n], respectively. Since these functions are all discrete- 
time Fourier transforms of sequences, they must be periodic with period lit. From 
Eqs. (A.36a) and (A.36b), it follows that, over one period \<o\ <n, 

<M* ;Vu ) = r«(e^) + 2ji\m x \ 2 8(a>), \<o\ < n, (A.43a) 
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and 

<MO = r xy (en + 27tm x m* y 8(co\ \co\ < tt. (A.43b) 

In the case of zero-mean processes (m x = and m y = 0), the correlation and co variance 
functions are identical so that <P xx (e Ja} ) = T xx (e ia> ) and <& xy (e ia) ) = T xy (e JQ} ). 
From the inverse Fourier transform equation, it follows that 

y xx [m] = ~ £ r xx (ene^dco, (A.44a) 

<p xx [m] = ^J* <t> xx (ene^ m dco, (A.44b) 

and, consequently, 

£{\x[n]\ 2 } = <t> xx [0] = a 2 x + \m x | 2 = 1- £ <t> xx (ei»)da>, (A.45a) 

a 2 x = y xx [0] = ±- y" r„(e^)dfl). (A45b) 

Sometimes it is notationally convenient to define the quantity 

P xx (co) = *„(*'"), (A.46) 

in which case Eqs.( A.45a) and (A.45b) are expressed as 

S{\x[n\\ 2 ) = -L f P xx (co)dco, (A47a) 






i2 



/>„(<»)<*» -|™*r. (A.47b) 



Thus, the area under P xx (co) for — 7r < co < n is proportional to the average power in 
the signal. In fact, as we discussed in Section 2.10, the integral of P xx (co) over a band 
of frequencies is proportional to the power in the signal in that band. For this reason, 
the function P xx (co) is called the power density spectrum, or simply, the power spectrum. 
When P xx (co) is a constant independent of co, the random process is referred to as a 
white-noise process, or simply, white noise. When P xx (co) is constant over a band and 
zero otherwise, we refer to it as bandlimited white noise. 

From Eq. (A.38b), it follows that P xx (a>) is always real valued, and for real random 
processes, <p xx [m] = <p xx [— m], so in the real case, P xx (co) is both real and even; i.e., 

P xx (a>) = P xx (-co). (A.48) 

An additional important property is that the power density spectrum is nonnegative. 
This point is discussed in Section 2.10. 

The cross power density spectrum is defined as 

Pxy(a>) = <*>xy(en. (A.49) 
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This function is generally complex, and from Eq. (A.38c), it follows that 

P xy (a) = P; x (a>). (A.50) 

Finally, as shown in Section 2.10, if x[n] is a random signal input to a linear time-invariant 
discrete-time system with frequency response H{e^) y and if y[n] is the corresponding 
output, then 

4>yy(et») = \H(en\ 2 <*>x*(en (A.51) 

and 

4> xy (en = H{en<b xy (en. (A.52) 



Example A. 1 Noise Power Output of Ideal 
Lowpass Filter 

Suppose that x[n] is a zero-mean white-noise sequence with (f> xx [m] = & x &[ m ] a nd 
power spectrum ^ xx {e^) — u\ for \a>\ < jt, and furthermore, assume that x[n] is 
the input to an ideal lowpass filter with cutoff frequency a) c . Then from Eq. (A.51), it 
follows that the output y[n] would be a bandlimited white noise process whose power 
spectrum would be 

*»(*"') = In*' N< .°Y (A- 53 ) 

yyy ' 1 0, co c < [co\ < n. v f 

Using the inverse Fourier transform, we obtain the autocorrelation sequence 

sin(a> c n) 

<p yy [m\ = . (A.54) 

Tin 

Now, using Eq. (A.45a), we get for the average power of the output, 

£{y 2 [n\) = <P yy [0] = — / aldio = a 1 ^. (A.55) 



A.5 USE OF THE ^TRANSFORM IN AVERAGE 
POWER COMPUTATIONS 

To carry out average power calculations using Eq. (A.45a), we must evaluate an in- 
tegral of the power spectrum as was done in Example A.l. While the integral in that 
Example was easy to evaluate, such integrals in general are difficult to evaluate as real 
integrals. However, a result based on the ^-transform makes the calculation of average 
output power straightforward in the important case of systems that have rational system 
functions. 

In general, the z-transform can be used to represent the covariance function but 
not a correlation function. This is because when a signal has nonzero average value, its 
correlation function will contain an additive constant component that does not have a 
z-transform representation. When the average value is zero, however, the covariance 
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and correlation functions are, of course, equal. If the z-transform of y^m] exists, then 
since ^[-/n] = x x *J/"] it follows that in general 

r*xM = r; x (i/z*). (A.56) 

Furthermore, since /^[/n] is two sided and conjugate-symmetric, it follows that the 
region of convergence of r xx (z) must be of the form 

1 

r a < \z\ < — 
r a 

where necessarily < r a < 1. In the important case when r xx (z) is a rational function of 

z, Eq. (A.56) implies that the poles and zeros of r xx (z) must occur in complex-conjugate 

reciprocal pairs. 

The major advantage of the z- transform representation is that when r xx (z) is a 

rational function, the average power of the random signal can be computed easily using 

the relation 

{Inverse z-transform 1 
ofr xx (z), \. (A.57) 

evaluated for m = J 

It is straightforward to evaluate the right-hand side of this equation using a method based 
on the observation that when T xx {z) is a rational function of z, y X x[m] can be computed 
for all m by employing a partial fraction expansion. Then to obtain the average power, 
we can simply evaluate /^[/h] for m = 0. 

The z-transform is also useful in determining the autocovariance and average 
power of the output of an LTI system when the input is a random signal. Generalizing 
Eq. (A.51) leads to 

r yy (z) = H(z)H*(l/z*)r xx (z), (A.58) 

and from the properties of the z- transform and Eq. (A.58), it follows that the autoco- 
variance of the output is the convolution 

Y yy [m] = h[m] * h*[-m] * y xx [m\. (A.59) 

This result is particularly useful in quantization noise analysis where we need to compute 
the average output power when the input to a linear difference equation is a zero- 
mean white noise signal with average power o\. Since the autocovariance of such an 
input is y^m] = cr^S[m] t it follows that the autocovariance of the output is y^lm] = 
ar^(h[m] *h*[— m]), i.e., the covariance of the output is proportional to the deterministic 
autocorrelation of the impulse response of the LTI system. From this result it follows that 

00 

£{y>]) = YyylO] = °l £ |/i[«]l 2 . (A.60) 

n=-oo 

As an alternative to computing the sum of squares of the impulse response sequence, 
which can be rather difficult for IIR systems, we can apply the method suggested in 
Eq. (A.57) to obtain £{.y 2 [/i]} from a partial fraction expansion of r yy (z). Recall that for 
a white noise input with y XJC [m] = cr^S[m] y the z-transform is r xx (z) = a\ so r yy (z) = 
olH{z)H*(l/z*). Therefore, Eq. (A.57) applied to the output of the system gives 

Inverse z-transform of 
£{y 2 ["]} = Yyy[0] = { r yy (z) = H(z)H'(l/t)crl *> . (A.61) 

evaluated for m = 
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Now consider the special case of a stable and causal system having a rational 
system function of the form 

M 

H(z) = A^ \z\ > max{|4|}, (A.62) 



nt 1 - ** -i > 



Jt=l 



where max^{|4t|} < 1 and M < N. Such a system function might describe the relation- 
ship between an internal round-off noise source and the output of a system implemented 
with fixed-point arithmetic. Substituting Eq. (A.62) for H(z) in Eq. (A.58) gives 



M 



Y[(l - C^Xl - C* mZ ) 

T„(z) = a, 2 ff(z)/T(l/z*) = ^\A\ 2 ^ • (A.63) 



k=\ 



Since we have assumed that |4tl < 1 for all k, all of the original poles are inside the 
unit circle and therefore the other poles at (d£) -1 are at conjugate reciprocal locations 
outside the unit circle. The region of convergence for r yy (z) is therefore max* \dk\ < 
\z\ < min* |(dj) -1 |. For such rational functions, it can be shown that since M < N, the 
partial fraction expansion has the form 



N 



1- 
where the coefficients are found from 



M-°nX{Trbz-r^*)h (A - 64) 



A = H( Z )/T(1/ Z *)(1 - dkZ-%^ . (A.65) 

Since the poles at z = d* are inside the inner boundary of the region of convergence, 
each of them corresponds to a right-sided sequence, while the poles at z = (d^)" 1 each 
correspond to a left-sided sequence. Thus, the autocovariance function corresponding 
to Eq. (A.64) is 

N 

Yyy[n] = *1 J2(Mdk) n u[n] + At(d' k )-"u[-n - 1]), 

Jt=l 

from which it follows that we can obtain the average power from 

o] = Yyy[0] = ol r£ AJ , (A.66) 

where the quantities A^ are given by Eq: (A.65). 

Thus, the computation of the total average power of the output of a system with 
rational system function and white noise input reduces to the straightforward problem 
of finding partial fraction expansion coefficients for the z-transform of the output auto- 
correlation function. The utility of this approach is illustrated by the following example. 
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Example A.2 Noise Power Output of a Second-Order IIR 
Filter 



Consider a system with impulse response 

r n sin0(« + l) 



h[n] = 



and system function 



H(z) = 



sinO 



1 



u[n] 



(l-re^z-^il-re-^z- 1 )' 



(A.67) 



(A.68) 



When the input is white noise with total average power a 2 , the ^-transform of the 
autocovariance function of the output is 



r yy (z) = a x 



1 



1 



{\-re> e z- l ){\-re-> d z- l )J \ (1 - re~i e z){\ ~ re&z) 
from which we obtain, using Eq. ( A.65), 

S{y 2 [n]} = a : 



(A.69) 



1 



1 



+ 



(1 - re-i e zr 1 )) \(1 - re-' e z)(l - rei e z) 
1 \ / 1 



(1 - rei e z- x )J \ (1 - re~i e z){\ - re' e z) 



Z=re'i e - 



(A.70) 



Making the indicated substitutions, placing both terms over a common denominator, 
and doing some algebra leads to 



^'-^f^V ^J^A 



(A.71) 



Thus, using the partial fraction expansion of r yy (z) we have effectively evaluated the 
expression 



£{ftn])=<T* J2 I*MI 2 = ", 2 £ 



n=0 



r"sin0(« + l) 



sin# 



which would be difficult to sum in closed form, and the expression 

da> 



£[yl[n]] = h F a x\^n\ 2 da» = £ r 



f_ n |(1 - reJ 9 e-^)(l - re-J $ e-J°>)\ 2 ' 
which would be difficult to evaluate as a real integral. 

The remarkably simple result of Example A.2 is an illustration of the power of the 
partial fraction method in evaluating average power formulas. In Chapter 6, we make 
use of this technique in the analysis of quantization effects in the implementation of 
digital filters. 



B 

Continuous-time filters 



The techniques discussed in Sections 7.1 and 7.2 for designing IIR digital filters rely 
on the availability of appropriate continuous-time filter designs. In this appendix,we 
briefly summarize the characteristics of several classes of lowpass filter approximations 
that we referred to in Chapter 7. More detailed discussions of these classes of filters 
appear in Guillemin (1957), Weinberg (1975), and Parks and Burrus (1987). Extensive 
design tables and formulas are found in Zverev (1967), and a variety of computer 
programs are available for computer-aided design of IIR digital filters based on analog 
filter approximations. (See, for example, Gray and Markel, 1976; DSP Committee 1979; 
Mersereau et al., 1984; and Mathworks, 1998.) 



B.I BUTTERWORTH LOWPASS FILTERS 

Butterworth lowpass filters are defined by the property that the magnitude response is 
maximally flat in the passband. For an Mh-order lowpass filter, this means that the first 
(2N — 1) derivatives of the magnitude-squared function are zero at Q = 0. Another 
property is that the magnitude response is monotonic in the passband and the stopband. 
The magnitude-squared function for a continuous-time Butterworth lowpass filter is of 
the form 

'^>' 2 = TTum^- (R1) 

This function is plotted in Figure B.l. 

As the parameter iVin Eq. (B.1) increases, the filter characteristics become sharper; 
that is, they remain close to unity over more of the passband and become close to zero 
824 
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Figure B.1 Magnitude-squared 
function for continuous-time 
n Butterworth filter. 




Figure B.2 Dependence of Butterworth 
magnitude characteristics on the 
order N. 



more rapidly in the stopband, although the magnitude-squared function at the cutoff 
frequency Q c will always be equal to one-half because of the nature of Eq. (B.1). The 
dependence of the Butterworth filter characteristic on the parameter N is indicated in 
Figure B.2. 

From the magnitude-squared function in Eq. (B.1), we observe by substituting 
jQ = s that Hc(s)Hc(—s) must be of the form 



H(s)Hc(-s) = 



l + (j/;O c ) 2JV " 



(B.2) 



The roots of the denominator polynomial (the poles of the magnitude-squared function) 
are therefore located at values of s satisfying 1 + (s/jQ c ) 2N = 0; i.e., 



S k = (_l)V2iV (/f2c ) = Qce (jn/2N)(2k + N-l) f * = 0, 1, . . . , 2AT - 1. 



(B.3) 



Thus, there are 27V poles equally spaced in angle on a circle of radius Q c in the s -plane. 
The poles are symmetrically located with respect to the imaginary axis. A pole never 
falls on the imaginary axis, and one occurs on the real axis for TV odd, but not for TV 
even. The angular spacing between the poles on the circle is tz/N radians. For example, 
for N =3, the poles are spaced by tz/3 radians, or 60 degrees, as indicated in Figure B.3. 
To determine the system function of the analog filter to associate with the Butterworth 
magnitude-squared function, we must perform the factorization Hc(s)Hc(— s). The poles 
of the magnitude-squared function always occur in pairs; i.e., if there is a pole at s = Sk, 
then a pole also occurs at s = — s*- Consequently, to construct He (s) from the magnitude- 
squared function, we would choose one pole from each such pair. To obtain a stable 
and causal filter, we should choose the poles on the left-half -plane part of the s -plane. 
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s-plane 




Figure B.3 s-plane pole locations for a 
third-order Butterworth filter. 



B.2 CHEBYSHEV FILTERS 



In a Butterworth filter, the magnitude response is monotonic in both the passband 
and the stopband. Consequently, if the filter specifications are in terms of maximum 
passband and stopband approximation error, the specifications are exceeded toward 
the low-frequency end of the passband and above the stopband cutoff frequency. A 
more efficient approach, which usually leads to a lower order filter, is to distribute the 
accuracy of the approximation uniformly over the passband or the stopband (or both). 
This is accomplished by choosing an approximation that has an equiripple behavior 
rather than a monotonic behavior. The class of Chebyshev filters has the property 
that the magnitude of the frequency response is either equiripple in the passband and 
monotonic in the stopband (referred to as a type I Chebyshev filter) or monotonic in 
the passband and equiripple in the stopband (a type II Chebyshev filter). The frequency 
response of a type I Chebyshev filter is shown in Figure B.4. The magnitude-squared 
function for this filter is of the form 

™ a #= i + *W a/a .y < R4 > 

where Vm(x) is the Mh-order Chebyshev polynomial defined as 

V N (x) = cos(ATcos _1 jc). (B.5) 

For example, for N = 0, Vq(x) = 1; for N = 1, Vi(jc) = cos(cos _1 jc) = jc; for N = 2, 
V^(jc) = cos(2cos _1 jc) = 2jc 2 — 1; and so on. 

From Eq. (B.5), which defines the Chebyshev polynomials, it is straightforward 
to obtain a recurrence formula from which VJv+i(jc) can be obtained from Vn(x) and 
Vjv-i(jc). By applying trigonometric identities to Eq. (B.5), it follows that 

V N+1 (x) = 2jcV^(jc) - V N -i(x). (B.6) 

From Eq. (B.5), we note that V^(jc) varies between zero and unity for < jc < 1. For 
jc > 1, cos -1 jc is imaginary, so V^(jc) behaves as a hyperbolic cosine and consequently 
increases monotonically. Referring to Eq. (B.4), we see that \Hc(jQ)\ 2 ripples between 
1 and 1/(1 + e 2 ) for < £1/ £l c < 1 and decreases monotonically for Q/ £2 C > 1- Three 
parameters are required to specify the filter: £, £2 C , and N. In a typical design, e is 



Sec. B.2 Chebyshev Filters 



827 




n 



Figure B.4 Type I Chebyshev lowpass 
filter approximation. 



/^--X- ' X J>\ 



/ j-plane 




Figure B.5 Location of poles for a 
third-order type I lowpass Chebyshev 
filter. 



specified by the allowable passband ripple and £3 C is specified by the desired passband 
cutoff frequency. The order N is then chosen so that the stopband specifications are 
met. 

The poles of the Chebyshev filter lie on an ellipse in the s -plane. As shown in 
Figure B.5, the ellipse is defined by two circles whose diameters are equal to the minor 
and major axes of the ellipse. The length of the minor axis is 2a Q c , where 



a = \(aV N -cr l ' N ) 



with 



a =s 1 + \/l +e~ : 



The length of the major axis is 2bQ c , where 



(B.7) 



(B.8) 



(B.9) 



To locate the poles of the Chebyshev filter on the ellipse, we first identify the points on 
the major and minor circles equally spaced in angle with a spacing of jr/Nin such a way 
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that the points are symmetrically located with respect to the imaginary axis and such 
that a point never falls on the imaginary axis and a point occurs on the real axis for N 
odd but not for TV even. Iriis division of the major and minor circles corresponds exactly 
to the manner in which the circle is divided in locating the poles of a Butterworth filter 
as in Eq. (B.3). The poles of a Chebyshev filter fall on the ellipse, with the ordinate 
specified by the points identified on the major circle and the abscissa specified by the 
points identified on the minor circle. In Figure B.5, the poles are shown for N = 3. 

A type II Chebyshev lowpass filter can be related to a type I filter through a 
transformation. Specifically, if in Eq. (B.4) we replace the term s 2 V^(Q/Q c ) by its 
reciprocal and also replace the argument of Vj by its reciprocal, we obtain 

lft( ' Q)|2 = i + pusU/o)]-! - (R10) 

This is the analytic form for the type II Chebyshev lowpass filter. One approach to 
designing a type II Chebyshev filter is to first design a type I filter and then apply the 
preceding transformation. 



B.3 ELLIPTIC FILTERS 

If we distribute the error uniformly across the entire passband or across the entire 
stopband, as in the Chebyshev cases, we are able to meet the design specifications with 
a lower order filter than if we permit a monotonically increasing error in the passband, 
as in the Butterworth case. We note that in the type I Chebyshev and Butterworth 
approximations, the stopband error decreases monotonically with frequency, raising the 
possibility of further improvements if we distribute the stopband error uniformly across 
the stopband. Trris suggests the lowpass filter approximation in Figure B.6. Indeed, it 
can be shown (Papoulis, 1957) that this type of approximation (i.e., equiripple in the 
passband and the stopband) is the best that can be achieved for a given filter order TV, 
in the sense that for given values of Q p , <$i, and 52, the transition band (Q s — Q p ) is as 
small as possible. 



Figure B.6 Equiripple approximation 
in both passband and stopband. 
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This class of approximations, referred to as elliptic filters, has the form 

'^ )|2 =iT^W (B11) 

where U^(Q) is a Jacobian elliptic function. To obtain equiripple error in both the 
passband and the stopband, elliptic filters must have both poles and zeros. As can be 
seen from Figure B.6, such a filter will have zeros on the jQ-axis of the s -plane. A 
discussion of elliptic filter design, even on a superficial level, is beyond the scope of this 
appendix. The reader is referred to the texts by Guillemin (1957), Storer (1957), Gold 
and Rader (1969), and Parks and Burrus (1987) for more detailed discussions. 
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Answers to selected 
basic problems 



This appendix contains the answers to the first 20 basic problems in each chapter. 

Answers to Basic Problems in Chapter 2 

2.1. (a) Always (2), (3), (5). If g[n] is bounded, (1). 

(b) (3). 

(c) Always (1), (3), (4). If n = 0, (2) and (5). 

(d) Always (1), (3), (4). If n < 0, (2). If n Q = 0, (5). 

(e) (1), (2), (4), (5). 

(f) Always (1), (2), (4), (5). If b = 0, (3). 

(g) (1), (3). 
(h) (1), (5). 

.2.2. (a) N* = N + jV 2 , JV 5 = M + N 3 . 

(b) At most N + M - 1 nonzero points. 
2.3. 



a 



y[n] = 



1-a 
1 

1-a 



w < 0, 
n >0. 



2A^[n] = 8[(l/2)"-(l/4)«Mn]. 
2.5. (a) y h [n] = A 1 (2) n + A 2 (3y. 

(b) /*M = 2(3" - 2 n )u[n\. 

(c) s[n] = [-8(2)( n -V + ^J^- 1 ) + i\u[n\. 
830 
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2.6. (a) 



H(e i( °) = 



1 + 2e-i" + e-i 2< ° 
1 — -e~J<° 



(b) y[n] + \y[n - 1] + |y[« - 2] = *[«] - ±*[/i - 1] + *[« - 3]. 

2.7. (a) Periodic, N = 6. 

(b) Periodic, N = 8. 

(c) Not periodic. 

(d) Not periodic. 

2.8. y[n] = 3(-l/2) n u[n] + 2(1/3) n u[n], 

2.9. (a) 



/i[«] = 2 



w[«], 



ip-j<» 



1 - |e~^ + \e-i lo >^ 



s[n] = 



-2i\)\(\)\l\u[nl 



(b) W [n] = A 1 (l/2)" + A 2 (l/3)«. 

(c) y[n] = 4(1/2)" - 3(1/3)" - 2(\/2) n u[-n - 1] + 2(l/3) n w[-n - 1]. 
2.10. (a) 



n J ~ \fl7a-fl- 1 ), «<-2. 



(b) 



(c) 



y[n] = 



y[n] = 



1, 



« > 3, 



2<«-3), «<2. 



1, « > 0, 
2 n , «<-l. 



(d) 



>M = 



0, ai > 9, 

1_2("- 9 ), 
2("+ 1 >_2^- 9 > 



8>« > -1, 



-2> 



> n. 



2.11. v[/i] = 2v^sin (n(n - l)/4) . 

2.12. (a) y[n] = n\u[n\. 

(b) Tlie system is linear. 

(c) The system is not time invariant. 
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2.13. (a), (b), and (e) are eigenf unctions of stable LTI systems. 

2.14. (a) (iv). 

(b) (i). 

(c) (w),h[n] = (l/2) n u[n], 

2.15. (a) Not LTI. Inputs 8[n] and 8[n - 1] violate TI. 

(b) Not causal. Consider x[n] = S[n — 1]. 

(c) Stable. 

2.16. (a) y h [n] = A^l/2)" + A 2 (-l/4)\ 

(b) Causal: h c [n] = 2(l/2) n u[n] + (~l/4) n u[n]. 

Anticausal: h ac [n] = -2(l/2) n u[-n - 1] - (-l/4) n w[-/i - 1]. 

(c) h c [n] is absolutely summable, h ac [n] is not. 

(d) y p [n] = (l/3)(-l/4)"ii[n] + (2/3)(1/2)"k[#i] + 4(n + l)(l/2)(" +1 >i<[#i + 1]. 

2.17. (a) 

sin(f) 

(b) W(ei a ) = (l/2)K(e' w ) + {\/A)R{e^- 271 ^) + (1/4)7? ( e /(«+2*/ji0) t 

2.18. Systems (a) and (b) are causal. 

2.19. Systems (b), (c), (e), and (f) are stable. 

2.20. (a) h[n] = (l/aY n -^u[n - 1], 

(b) The system will be stable for |a| > 1. 



Answers to Basic Problems in Chapter 3 

3.1. (a) _\ _ r \z\>\. 
(b) — ^— , \z\ < 1. 

i. 2 Z 

(d) 1, allz. 

(e) z'\ z^O. 

(f) z, \z\ < oo. 

i_ aV 7-io 

(g) _ 2 1 _ t , W^O. 

3.2. X(z) = V _- U2 ■ 



(1-z- 1 ) 
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3.3. (a) X a (z) = jz Z i" \ n , ROC: |«| < |z| < \a 

(1 — az~ l )(l — cx- l z~ l ) 

\-z~ N 
(b) X b (z) = 1 __ _ l t ROC: z * 0. 



(c) X c (z) = z~ lV - zz ^ 9 ROC: z ? 0, 



(1-z" 1 )' 

3.4. (a) (1/3) < |z| < 2, two sided. 

(b) Two sequences. (1/3) < \z\ < 2 and 2 < \z\ < 3. 

(c) No. Causal sequence has \z\ > 3, which does not include the unit circle. 

3.5. x[n] = 2S[n + 1] + 58[n] - 4S[n - 1] - 3S[n - 2]. 

3.6. (a) x[n] = (—\) u[n], Fourier transform exists. 

(b) x[n] = — (— i) u[— n — 1], Fourier transform does not exist. 

(c) x[n] = 4 (~\) u[n] — 3 (— ~) u[n], Fourier transform exists. 

(d) x[n] = (— j) u[n] y Fourier transform exists. 

(e) x[n] = — (a~(" +l })u[n\ + a~("~^u[n — 1], Fourier transform exists if \a\ > 1, 

3.7. (a) //( Z ) = i^i- r , | Z |>i. 

(b) ROC{y(z)} = |z| > 1. 

(O y[n]=[-l(\) H + l{-ir]u[n]. 

3.8. (a) h[n] = (-1)" u[n] - (-l) n ~ l u[n - 1]. 

(c) The system is stable. 

3.9. (a) |z| > (1/2). 

(b) Yes. The ROC includes the unit circle. 

(d) h[n] = 2(\)"u[n]-(-\) n u[n]. 

3.10. (a) \z\>l 

(b) < |z| < oo. 

(c) |z| < 2. 

(d) |z| > 1. 

(e) |z| < oo. 

(f) \<\z\< VT3. 

3.11. (a) Causal. 

(b) Not causal. 

(c) Causal. 

(d) Not causal. 
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(b) 



(c) 




3.13. g[ll] = -± + | - \. 

3.14. A x = A 2 = 1/2, a x = -1/2, <x 2 = 1/2. 

3.15. h[n]= (|) (u[/i] - w[az — 10]). The system is causal. 

3.16. (a) H{z) = !"f , , |z| > |. 



1 



2 Z -1' 
3^ 



Figure P3. 12-1 



Figure P3. 12-2 



Figure P3.12-3 



(b) h[n] = (l) n u[n] -2 (lf- l) u[n- I]. 
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(c) y[n] — \y[n — 1] = x[n] — 2x\n — 1]. 

(d) The system is stable and causal. 

3.17. h[0] can be 0, 1/3, or 1. To be painstakingly literal, h[0] can also be 2/3, due 
to the impulse response h[n] = (2/3)(2) n u[n] - (l/3)(l/2)"u[-n - 1], which 
satisfies the difference equation but has no ROC. This noncausal system with no 
ROC can be implemented as the parallel combination of its causal and anticausal 
components. 

3.18. (a) h[n] = ~2S[n] + \(-\) n u[n] + f u[n]. 

(b) y[n] =(-?—) e i(7T/2) "' 

3.19. (a) |z| > 1/2. 

(b) 1/3 < \z\ < 2. 

(c) |z| > 1/3. 

3.20. (a) \z\ > 2/3. 
(b) \z\ > 1/6. 

Answers to Basic Problems in Chapter 4 

4.1. x[n] = sin(jr«/2). 

4.2. Q = 250jt, 1750;r. 

4.3. (a) T = 1/12,000. (b) Not unique. T = 5/12,000. 

4.4. (a) T = 1/100. (b) Not unique. T = 11/100. 

4.5. (a) T < 1/10,000. (b) 625 Hz. (c) 1250 Hz. 

4.6. (a) Hc(jQ) = 1/(<i + jQ). 

(b) Hd(e ia ) = T/(l - e~ aT e-^). 

4.7. (a) 

(b) H(eJ a, ) = l+ae-> (or < l/T . 

(c) (i) h[n] = 8[n]+a8[n-l]. 

4.8. (a) T < 1/20,000. 

(b) h[n] = Tu[n\. 

(c) AV)L =0 . 

(d) T < 1/10,000. 

4.9. (a) X(e* w +^) = X(e^ (0+n -^) = X(e> w ) . 
(b) jc[3] = 0. 

y[n/2], n even, 



(c) x[n] = . n , , 

L J '0, n odd. 
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4.10. (a) 


x[n] = cos(2nn/3). 


(b) 


x[n] = — sin(27Tfz/3). 


(c) 


x[n] = sm(2jtn/5)/(7Tn/5000). 


4.11. (a) 


T = 1/40, T = 9/40. 


(b) 


t = 1/20, unique. 


4.12. (a) 


(0 ydO = — 67rsin(67rf). 




00 ydO = —67tsm(67Tt). 


(b) 


(i) Yes. 




(ii) No. 


4.13. (a) 


y[n] = sin (f -J). 


(b) 


Same y[n]. 


(c) 


h c (t) has no effect on T. 


4.14. (a) 


No. 


(b) 


Yes. 


(c) 


No. 


(d) 


Yes. 


(e) 


Yes. (No information is lost; however, the signal cannot be recovered by the 




system in Figure 3.21.) 


4.15. (a) 


Yes. 


(b) 


No. 


(c) 


Yes. 


4.16. (a) 


M/L = 5/2, unique. 


(b) 


MIL = 2/3; also, M/L = 7/3. 


4.17. (a) 


x d [n] = (4/3)sin(7r«/2)/(7r«). 


(b) 


x d [n] = — sin (3ttai/4) . 


4.18. (a) 


O>o = 27T/3. 


(b) 


coq = 3n/5. 


(c) 


COO = 7T- 


4.19. T<7i/£2 . 


4.20. (a) 


F s > 2000 Hz. 


(b) 


F s > 4000 Hz. 



Answers to Basic Problems in Chapter 5 

5.1. x[n] = y[n], co c = n. 

5.2. (a) Poles: z = 3, 1/3, Zeros: z = 0, oo. 

(b) h[n] = -(3/S)(l/3) n u[n] - (3/S)3 n u[-n - 1]. 

5.3. (a), (d) are the impulse responses. 

5.4. (a) H(z) = ]~] Z 1 t |z| > 3/4. 

1 — z~ 

(b) h[n] = (3/4)"u[n] - 2(3/4) n u[n - 1]. 

(c) y[n] - (3/4)y[n - 1] = x[n] - 2x[n - 1]. 



App. C Answers to Selected Basic Problems 



837 



(d 

5.5. (a 
(b 
(c 

5.6. (a 

(b 
(c 

5.7. (a 

(b 
(c 

5.8. (a 

(b 
(c 
5.9. 



Stable and causal. 

y[n]-(7/12)y[n-l]+(l/12)y[n-2] = 3x[n]~(19/6)x[n-l]+(2/3)x[n-2]. 

h[n] = 38[n] - (2/3)(\/3) n ~ l u[n - 1] - (3/4)(l/4)"- 1 u[n - 1]. 

Stable. 

1 



X(z) = 



1 

(l-h-i)(l-2z-i) 



< \z\ < 2. 



\ < \z\ < 2. 

h[n] = 8[n]-8[n- 2]. 



(l-k-'Ki + lz- 1 ) 



Izl > ? 



AH = -(2/5)(l/2)««[«] + (7/5X-3/4)"«[n]. 

A"] + (l/4)y[n - 1] - (3/8)>[n - 2] = *[»] - jt[« - 1]. 

,-1 



H(z) = 



l-|z-'-Z-2 



Izl > 2. 



/,[«] = -(2/5)(-1/2)"ii[»] + (2/5X2) "«[«]. 
«[n] = -(2/5)(-l/2)"«M - (2/5)(2)"m[-h - 1]. 



h[n] = 



-l (2) "- 1 



1 /I 
+ 3 2 



n-l 



u[-n], 



\z\ < - 



h[n] = -\(2)"- l u[-n]-\{]X "[n-l], 



%] = 5(2)"- 1 «[n-l]-i(i 



n-l 



u[n- 1], 



2 < kl < 2 ' 



kl > 2. 



5.10. 
5.11. 



5.12. 



Hi (z) cannot be causal and stable. The zero of a H(z) at z = oo is a pole of //, (z). 
The existence of a pole at z = oo implies that the system is not causal. 

(a) Cannot be determined. 

(b) Cannot be determined. 

(c) True. 

(d) False. 

(a) Stable. 
(b) 

H m = 9 a+o^- 1 )(i-^- 1 )(i+^- 1 ) 

1KZ) (l-y0.9z-i)(l + /0.9z-i) ' 



HUz) = 



U- 1 -J)(«- 1 + J) 



5.13. 
5.14. 



(1-Jz-i) (l + ^-i) 

Hi(z), H-$(z)i and #4(z) are all-pass systems. 

(a) 5. 

(b) i 
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5.15. (a) a = 1, /J = 0, A(e j( °) = 1 + 4cos((on). The system is a generalized linear- 

phase system but not a linear-phase system, because A(e JCO ) is not nonneg- 
ative for all w. 

(b) Not a generalized linear-phase or a linear-phase system. 

(c) a = 1,0 = 0, A(e j( °) = 3 + cos(w/i). Linear phase, since \H(e' a )\ = 
^(e ;V )>0foralla>. 

(d) a = 1/2, /J = 0, A{e ia> ) = 2cos(w«/2). Generalized linear phase, because 
A(e }{ °) is not nonnegative at all co. 

(e) a = 1, p = tt/2, J *4(e' (U ) = 2sin(ww). Generalized linear phase, because 

5.16. h[n] is not necessarily causal. Both h[n] = S[n — a] and h[n] = <5[n + 1]+ 
<S[/i — (2a + 1)] will have this phase. 

5.17. H2(z) and #3(2) are linear-phase systems. 

2(1- ^"M 

5.18. (a) // min (z) = -i ^— A 

1 + iz" 1 

(b) H min (z) = 3ri-iz- 1 

(Of/ fa) 9 (1-^)(1-^) 

(c) H m (z) - 4 (i _ ^_ i)2 • 

5.19. hi[n] : 2, /i 2 [w] : 3/2, h 3 [n] : 2, h A [n] : 3, fc 5 [#i] : 3, h 6 [n] : 7/2. 

5.20. Systems H\{z) and #3(z) have a linear phase and can be implemented by a 
real-valued difference equation. 

Answers to Basic Problems in Chapter 6 

6.1. Network 1: 

H(z) = 



1 — 2r cos#z _1 +r 2 z~ 2 ' 
Network 2: 

H(?\ = rsin ^" 1 

K } l-2rcos6>z- 1 +r 2 z- 2 ' 

Both systems have the same denominators and thus the same poles. 

6.2. y[n] - 3y[n - 1] - y[n - 2] - y[n - 3] = *[w] - 2x[n - 1] + jc[« - 2]. 

6.3. The system in Part (d) is the same as that in Part (a). 

6.4. (a) 

2+k" 1 



(b) 



Hw - i^-'-i*- 



y[n] + -y[n - 1] - -y[n - 2] = 2x[n] + -x[n - 1]. 
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6.5. (a) 
(b) 



y[n\ - 4y[n - 1] + ly[n - 3] + 2y[n - 4] = x[n], 

1 



H(z) = 



l-4z- ! +7z- 3 +2z 



(c) Two multiplications and four additions. 

(d) No. It requires at least four delays to implement a fourth-order system. 



6.6. 



1 



1 



-2 



Zl 



2 3 5 6 7 





4< 


> 






3< 


> 


.'J 




/I . . 


-1 


2 3 1 5 6 7 


-2 J 


• 







(a) 



(b) 



-10ll34J6789 



Jl 



-1 



^T 



1„ 



(c) 



3(5678 
(d) 



Figure P6.6-1 



6.7. 




Figure P6.7-1 

6.8. y[n] - 2^[n - 2] = 3*[n - 1] + x[n ~ 2]. 

6.9. (a) /i[l] = 2. 

(b) y[n] + j/[/i - 1] - 8y[n - 2] = jc[/i] + 3x[n - 1] + jc[/i - 2] - &c[/i - 3]. 

6.10. (a) 

y[n] = x[n] + v[« - 1]. 

1 
v[n] = 2*[«] + -y[n] + w[n - 1]. 



w[n] = x[n] + -y[n]. 
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(b) o »- o »» o » o * o *■ o *■ o *■ o 



x[n] 





y["] 



Figure P6.10-1 



(c) The poles are at z = —1/2 and z = 1. Since the second pole is on the unit 
circle, the system is not stable. 



6.11. (a) 




Figure P6.11-1 



(b) 



x[n] 



6 * 6 



,. Z 



-6 

6 » 6 



* o * O 



y[n] 



M z 



1 

-i 2 



n Z 



Figure P6. 11-2 



6.12. y[n] - 8y[n - 1] = -2x[n] + 6x[n - 1] + 2x[n - 2]. 
6.13. 




Figure P6.13-1 
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6.14. 



x[n] 



1 "z" 1 5 



6 

►— 



y[»\ 



Figure P6.14-1 



6.15. 



x[n] 



->z" 



o *- 



-1 



1 I^I 
2 



y[»] 



Figure P6.15-1 



6.16. (a) 




Figure P6.16-1 



(b) 



6.17. (a) 



Both systems have the system function 



H{z) = 



l-^- 2 



(b) 




Figure P6.17-1 



Figure P6.17-2 



6.18. If a = 2/3, the overall system function is 



l + \z- l -\z- 2 



If a = —2, the overall system function is 



1-fz-' 



l + iz->-|z- 2 
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6.19. 



6.20. 





t 


1 -8 


9 








x[n] 


1 




1 
3 






y[n] 












Z" 1 ' 


2 
3 






Figure P6.19-1 










[n] 

1 


2 


> 
1 

) 
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c 
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c 
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2 


r 

y[n] 




5 z" 1 ' 

4 

1 ► d 


-1 

1) ■* 


Figure P6.20-1 



Answers to Basic Problems in Chapter 7 

7.1. (a) 

1 - e~ aT cos(bT)z~ l 



Hx{z) = 



1 - 2e- aT cos(bT)z~ 1 + e- 2 " 7 * 



(b) 



H 2 (z) = (1 - z- l )S 2 (zl where 



1 



1 



1 



a 2 + &2 1 - z- 1 2(a + ;6) 1 - c -(fl+/*)r z -i 2(0 - ;7?) 1 - g-(«-i*)r z -i 
(c) They are not equal. 
7.2. (a) 





l*/ c (/-n)| 


1 


:.> _*--!=.■ -:■/. 


0.89125 


1 

1 


1 
1 
1 
1 
1 


0.17783 


1 

! 

1 
1 
1 


1 1 
1 1 



0.2 77" 0.3 IT 



a 



Figure P7.2-1 
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(b) JV = 6, n c r rf = 0.7032. 

(c) The poles in the s -plane are on a circle of radius R = 0.7032/ Tj. They map 
to poles in the z-plane at z = e SkTi '. The factors of 7^ cancel out, leaving the 
pole locations in the z-plane for H(z) independent of Tj. 

7.3. (a) S 2 = 5 2 /(l +5i). 
(b) 

<5 2 =0.18806 

0.3036 -0.4723z _1 -2.2660 + 1.2114* - 1 

#(Z) = 1 i ^ _1 , n . nAn ,9 + 



1 - 129Hz- 1 + 0.6949z~ 2 1 - 1.069U- 1 + 0.3699z~ 2 

1.9624 -0.6665z _1 

+ 



l-0.9972z- 1 +0.2570z- 2 
(c) Use the same <5 2 . 

0.0007802(1 + Z- 1 ) 6 



(1 - 1.2686Z" 1 +0.7051z- 2 )(l - 1.0106Z- 1 + 0.3583z- 2 )(l - 0.9044Z" 1 + 0.2155z" 2 ) 
7.4. (a) 

1 0.5 



H c (s) = 



s+0.1 5+0.2 
The answer is not unique. Another possibility is 

1 0.5 

H c (s) = 



s +0.1 + jln 5 + 0.2+ j2n 
(b) 

2(1+5) 1+5 



H c (s) = 



0.1813 + 1.81875 0.3297 + 1.67035 
This answer is unique. 

7.5. (a) A/+1 =91. 

(b) M/2 = 45. 

, _ _ sin [0.625jr(n- 45)1 sin [0.3* (n - 45)] 

(c) h d [n\ = — — . 

7t(n-45) 7i(n -45) 

7.6. (a) 5 = 0.03,0 = 2.181. 
(b) Aw = 0.05;r,M = 50. 

7.7. 

0.99 < \H(e>°>)\ < 1.01, M < 0.2;r, 

\H(e> a )\ < 0.01, 0.22;r < \eo\ < tz 

7.8. (a) Six alternations. L = 5, so this does not satisfy the alternation theorem and 

is not optimal. 
(b) Seven alternations, which satisfies the alternation theorem for L = 5. 

7.9. co c = 0.4;r. 

7.10. co c = 2.3842 rad. 

7.11. Q c = 2^(1250) rad/sec. 
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7.12. 
7.13. 
7.14. 
7.15. 

7.16. 

7.17. 



Q c = 2000 rad/sec. 

T — 50 /xs. This T is unique. 

T = 1.46 ms. This T is unique. 

The Hamming, Hanning, and Blackman windows may be used. 

0=2.6524, Af= 181. 



\H c (jQ)\ <0.02, 
0.95 < \HcUQ)\ < 1.05, 
\H c (jQ)\ < 0.001, 



|fi| < 2?r(20) rad/sec, 

2tt(30) < \Q\ < 2tt(70) rad/sec 

In (75) rad/sec < |ft|. 



7.18. 



7.19. 

7.20. 



|// c (/fl)| <0.04, 
0.995 < \H c (jQ)\ < 1.005, 

T = 0.41667 ms. This T is unique. 
True. 



\Q\ < 726.5 rad/sec 
\Q\ > 1376.4rad/sec. 



Answers to Basic Problems in Chapter 8 



8.1. (a) 
(b) 
(c) 



x[n] is periodic with period N = 6. 
T will not avoid aliasing. 



8.2. (a) 



(b) 



X[k] = 2n < 



fl + «6 + fl -6> k = 0, 

a\ + a 7 +fl_5, k= 1, 

^2+^8+^-4, k = 2, 

a 3 + a 9 + fl_3 + <2_9, A: = 3, 

04+0-2+^-8, /C = 4, 

fl 5 +fl_ 1 +fl_ 7l fc = 5. 



~ _ /3Jr[*/3], for* = 3£, 



X* = 



U 



*[*] = 



* 3 [*] = 



otherwise. 



3, * = 0, 

-1, *=1. 

9, k = 0, 

0, *=1,2,4,5, 

-3, * = 3. 



8.3. (a) j^M- 

(b) None of the sequences. 

(c) x\[n] and ^[m]. 

8.4. (a) 



X(e ja> ) = 



1 - ae~i l 
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(b) 



(c) 



X[k] = 



1 



1 _ ae -j(27T/N)k 



X[k] = X(en\^ { 2xk,N). 



8.5. (a) X[k] 

(b) X[k] 
(c) 



(d) 



= 1, 



kno 

N ■ 



(e) 



8.6. (a) 



(b) 



(c) 



8.7. 



8.8. 



L J (^ 0, otherwise. 



X[k] = 



/V/2, * = 0, 

0, otherwise. 



X[k] = 



X(e> w ) = 



X[k] = 



X[k} = 



1-fl 



1 


-aW#" 


1- 


_ e J(o>o-<o)N 


1 


— ej(ojo-oj) 


1 


_ e Ju>tiN 


1- 


■ewWfi' 


/v, 


k— /co 


o, 


otherwise 



2< 


' 2' 


» 






x x {n\ 


— • 




1< 


> 1< 


•— 


— • 



-10 12 3 4 5 n 



Figure P8.7-1 



rio24m« n<«<9 

y r„i _ J 1023 \2) ' u - " - y ' 

\0, otherwise. 



8.9. (a) 1. Let x x [n] = Em *[" + 5m l 

2. Let Ai [A:] be the five-point FFT of x x [«]. M = 5. 

3. Ai[2] is X(e^) at <w = 4tt/5. 

(b) 1. Let xi[ri\ be jc[/i] followed by seven zeros. 

2. Let X 2 [k] be the 27-point FFT of x 2 [n]. L = 27. 

3. X 2 [5] is X(e^) at co = IOtt/27. 
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8.10. 
8.11. 



X 2 [k] = (~\) k X,[kl 





6- 


i 








5< 


» 








4< 


> 






3- 


i 








2« 


> 






• — 




J_ 






• — • 



-101234567 n 



Figure P8.11-1 



8.12. (a) 



(b) 



*ra={S: iiil 



H[k] = 



15, A: = 0, 

-3 + /6, *=1, 

-5, * = 2, 

—3 — /6, A; = 3. 

(c) y[«] = -35[w] - 6S[n - 1] + 35[« - 2] + 6% - 3]. 

(d) y[n] = -3S[n] - 68[n - 1] + 35[« - 2] + 6% - 3]. 



8.13. 



1 



2f 



^u 



y[«] 



8.14. 
8.15. 
8.16. 

8.17. 
8.18. 
8.19. 
8.20. 



1012345 Figure P8.13-1 

* 3 [2] = 9. 

a = — 1. This is unique. 

£ = 3. This is unique. 

N = 9. 

c = 2. 

m = 2. This is not unique. Any m = 2 + 6£ for integer ^ works. 

N = 5. This is unique. 



Answers to Basic Problems in Chapter 9 

9.1. If the input is (l/N)X[((—n))^], the output of the DFT program will be x[n], 
the IDFT of X[k\. 

9.2. (a) The gain is -W$. 

(b) There is one path. In general, there is only one path from any input sample 
to any output sample. 

(c) By tracing paths, we see 

X[2] = x[0] ■ 1 + jc[1] W? - x[2] - x[3]W£ + ... 
x[4]+x[5]W 8 2 -x[6]-x[l]W s 2 . 
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9.3. (a) Store x[n] in A [•] in bit-reversed order, and D[] will contain X[k] in sequen- 
tial (normal) order. 
(b) 

'N, r = 3, 



L J 1 0, otherwise. 
(c) 

Cr r i _ J 1 ' r =0 ' 1> 2 ' 3 ' 
L J \ 0, otherwise. 

9.4. (a) N/2 butterflies with 2< m ~ 1 ) different coefficients. 

(b) y[n] = W$' m y[n ~ \] + x[n]. 

(c) Period: 2"\ Frequency: 2^2 _m . 

9.5. 

X= AD- BD + CA- DA= AC- BD 

Y= AD- BD+ BC+ BD= BC+AD. 

9.6. Statement 1 . 

9.7. o) k = 7;r/16. 
9.8. 

y[n] ~ X(e J( °)\ co=i 2jT/7)+(2n/2])(n-l9)- 

9.9. (a) 2 ml . 
(b) 2 m . 

9.10. r[n] = e ->^/i9) w » 2 /2 where w = e -j{2x/\o) t 

9.11. jt[0], jc[8], *[4], *[12], jc[2], jc[10], *[6], jc[14], *[1], *[9], jc[5], jc[13], *[3], jc[11], 
jc[7], jc[15]. 

9.12. False. 

9.13. m = 1. 
9.14. 

(0, /w = 0, 

0,4, m = \, 

0,2,4,6, m = 2, 

0,1,2,3,4,5,6,7, m = 3. 

9.15. N = 64. 

9.16. /w = 3 or 4. 

9.17. Decimation-in-time. 

9.18. 1021 is prime, so the program must implement the full DFT equations and cannot 
exploit any FFT algorithm. The computation time goes as JV 2 . Contrastingly, 1024 
is a power of 2 and can exploit the iVlog N computation time of the FFT. 

9.19. 

a = -V2 

9.20. 

y[n] = e J(2n/32)l x ^ e j(lnn6)y 
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Answers to Basic Problems in Chapter 1 

10.1. (a) / = 1500 Hz. 
(b) / = -2000 Hz. 

10.2. N = 2048 and 10000 Hz < / < 10240 Hz. 

10.3. (a) 320 samples. 

(b) 400 DFT/second. 

(c) N = 64. 

(d) 250 Hz. 

10.4. (a) ^[200] = 1 - j. 
(b) 

^(/2tt(4000)) = 5 x 10 _5 (1 - /) 

*(-/27r(4000)) = 5 x 10- 5 (1 + /). 

10.5. (a) T = 27Tko/(NQ ). 

(b) Not unique. T = (2tt/^ )(1 - k /N). 
10.6. 

^0'27r(4200)) = 5 x 10~ 4 

^ c (-y27r(4200)) = 5 x 10" 4 

X c (j2x(l(m)) = 10" 4 

^ c (-y27r(1000)) = 10~ 4 

10.7. L = 1024. 

10.8. Rectangular, Hanning, Hamming, and Bartlett windows work. 

10.9. X2[n] will have two distinct peaks. 

10.10. T > 1/1024 sec. 

10.11. A£2 = 2tt(2.44) rad/sec. 

10.12. N > 1600. 
10.13. 

X [k] = 

Xi[k] = 

10.14. x 2 [n], x 3 [n], x 6 [n]. 

10.15. too = 0.25tt rad/sample, A = tt/80000 rad/sample 2 . 

10.16. A/ = 9.77 Hz. 

10.17. Methods 2 and 5 will improve the resolution. 

10.18. The peaks will not have the same height. The peak from the rectangular window 
will be bigger. 

10.19. L=M+ 1 = 124. 

10.20. (a) A=44.68dB. 

(b) Weak components will be visible if their amplitude exceeds 0.0058. 



18, 


k = 3, 33, 


o, 


otherwise 


18, 


k = 9, 27, 


0, 


otherwise 
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Answers to Basic Problems in Chapter 1 1 

11.1. Jm{X(ei'°)} = 2a sin a). 

11.2. x[n] = (5/4)%] - 8[n - 1], 
11.3. 

x l [n] = 8[n]- l -8[n-l] 

x 2 [n] = 8[n] - -8[n + 1]. 

11.4. Ke{X(e jco )} = 1 - cos(2^), Jm{X(e^)} = 0. 

11.5. (a) Xi[n] = sinct»o«. 

(b) xi[n] = — cosajQn. 

(c) X[[n] = (1 - cos co on) /(nn). 

11.6. x[n] = 58[n] - 28[n - 1] + 38[n - 4]. 

11.7. (a) x[n] = -8[n - 1] - 28[n - 2\ 

(b) Not unique. x[n] = 8[n] — 8[n — 1] — 28[n — 2] also satisfies the information 
given. 

11.8. X R2 (e ji °) and X R3 (e ia> ) are the answers. 

11.9. x[n] = — 8[n]— 38 [n— 1]— 8 [n— 3] is the unique sequence satisfying the information 

given. 

11.10. h[n] = ±(1/2) {(-l/2) n u[n] - (1 /2)(-l/2) n ~ l u[n - 1]} . 
11.11. 

16sin3&>, < co < n, 



^ " 1 0, otherwise. 

Jm{JT(0} = 0. 

11.12. (a) h[n] = 8[n] - (l/3)8[n - 1]. 
(b) h[n] = (l/3)<5["] - 8[n - 1]. 

11.13. Xi(e jco ) = cosco — sinoj — cos2&>. 

11.14. X/(0 = £X (l/2)*sin£w. 

11.15. x[n] = 48[n] - 8[n - 1]. 

11.16. The facts are not consistent. 

11.17. x[n] = — 8[n] +38[n — 1] is the unique sequence satisfying the information given. 

11.18. Two choices are x[n] = 18[n] + 28[n - 1] or x[n] = 78[n] + 28[n - 2]. 

11.19. jXi[k] = -J8[k-1] + j8[k- 3]. 

11.20. X2[n] and x^ln] are consistent with the information given. 



